00000001:02000400:1.0F:1788521138.657908:0:2956:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788521159.926086:0:3177:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788521161.954212:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1139 MB/s 00000001:01000000:2.0:1788521162.204165:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 835 MB/s 00000001:01000000:2.0:1788521162.454329:0:3236:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3275 MB/s 00000020:02000000:2.0:1788521163.505591:0:3269:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g1e70112 00000400:02000000:0.0:1788521164.833650:0:3284:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.148@tcp [8/256/0/180] 00008000:02000000:0.0:1788521169.344188:0:3434:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788521220.369480:0:5240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788521230.177934:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788521230.177940:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788521230.180067:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000acda23be 00000080:02000400:1.0:1788521230.180082:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788521230.188848:0:5814:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788521230.188860:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788521230.188897:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000066b9a762) 00000020:00000080:1.0:1788521230.188927:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788521230.214446:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788521230.214846:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0F:1788521230.257384:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788521230.257435:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788521230.257457:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788521230.257505:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788521230.257530:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788521230.257917:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788521230.257925:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788521230.257935:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae01600e 00000020:01000004:3.0:1788521230.257943:0:5814:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788521230.257948:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788521230.257952:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000acda23be from MGS 00000020:01000004:3.0:1788521230.257957:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788521230.257975:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001da9a11b) 00000020:00000080:3.0:1788521230.257986:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788521230.261930:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000acda23be from MGS, refs=2 00080000:01000000:3.0:1788521230.261948:0:5814:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521230.261960:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae01601c 00000100:00100000:2.0:1788521230.263213:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788521230.263366:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788521230.263373:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788521230.264348:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788521230.264359:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788521230.266480:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521230.266683:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788521230.266689:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788521230.267581:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788521230.267590:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788521230.268352:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788521230.268368:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788521230.269014:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521230.269026:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521230.269028:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521230.272206:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521230.272212:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521230.272215:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521230.272906:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788521230.280079:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788521230.524002:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2126 MB/s 00000001:01000000:1.0:1788521230.774110:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2803 MB/s 00000001:01000000:2.0:1788521231.027462:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 644 MB/s 00000001:01000000:0.0:1788521231.276991:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 647 MB/s 00080000:10000000:1.0:1788521231.287592:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788521231.303310:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788521231.303328:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788521231.303330:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788521231.306941:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788521231.307028:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788521231.307090:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788521231.307296:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788521231.307317:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788521231.308175:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521231.308325:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788521231.308331:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788521231.311701:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788521231.311720:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788521231.321714:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788521231.321727:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788521231.323966:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788521231.323988:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.148@tcp' 00000020:01000004:1.0:1788521231.323990:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788521231.324104:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.148@tcp (typ=mgc) 00000020:00000080:1.0:1788521231.324117:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.148@tcp (000000008c0229ec) 00000020:00000080:1.0:1788521231.324132:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:0.0:1788521231.324376:0:5829:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:1.0:1788521231.325719:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cec0768f@MGC192.168.203.148@tcp: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1788521231.325904:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.148@tcp-0 is initialized 00000040:01000000:1.0:1788521231.325911:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788521231.333358:0:5830:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788521231.333411:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.148@tcp (uuid 02b855e8-b82d-4a25-90ff-ed0c016d947b) 00000020:00000080:0.0:1788521231.333437:0:5814:0:(genops.c:1385:class_connect()) connect: client 02b855e8-b82d-4a25-90ff-ed0c016d947b, cookie 0x53df1cebae01602a 00000100:00080000:0.0:1788521231.333449:0:5814:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521231.333455:0:5814:0:(import.c:665:import_select_connection()) MGC192.168.203.148@tcp: import 00000000cec0768f using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521231.333505:0:5814:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004446b590 x1875400368062592/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521231.333548:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 02b855e8-b82d-4a25-90ff-ed0c016d947b->MGS 00000020:01000004:0.0:1788521231.333569:0:5814:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788521231.333592:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788521231.333612:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b724388b) 00000020:00000080:0.0:1788521231.333625:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788521231.340320:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004446b590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02b855e8-b82d-4a25-90ff-ed0c016d947b:3299:1875400368062592:0@lo:250: 00000100:00100000:1.0:1788521231.340423:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521231.342080:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368062592 00000100:00100000:1.0:1788521231.342091:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368062592 00000100:00100000:1.0:1788521231.342124:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521231.342130:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7011976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875400368062592:12345-0@lo:250: 00010000:00080000:1.0:1788521231.342153:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 02b855e8-b82d-4a25-90ff-ed0c016d947b@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1788521231.342691:0:5825:0:(genops.c:1385:class_connect()) connect: client 02b855e8-b82d-4a25-90ff-ed0c016d947b, cookie 0x53df1cebae016038 00000100:00080000:1.0:1788521231.343241:0:5825:0:(import.c:65:import_set_state_nolock()) 00000000f937bca1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521231.343324:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7011976 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:3299:x1875400368062592:12345-0@lo:250: Request processed in 1192us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521231.343334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521231.343379:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788521231.343387:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1788521231.343394:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788521231.343398:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788521231.343401:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000cec0768f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788521231.343404:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788521231.343407:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788521231.343411:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004446b590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02b855e8-b82d-4a25-90ff-ed0c016d947b:3299:1875400368062592:0@lo:250: 00010000:00010000:2.0:1788521231.343756:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521231.365206:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521231.365424:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788521231.365430:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788521231.368538:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521231.368551:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788521231.369364:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521231.369372:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788521231.371180:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521231.371686:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788521231.371693:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788521231.373605:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788521231.373616:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788521231.431372:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521231.431595:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788521231.431603:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788521231.433761:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788521231.433802:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788521231.434603:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521231.434753:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788521231.434757:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788521231.435336:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788521231.435342:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788521231.445387:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521231.445585:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521231.445592:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788521231.453443:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788521231.453460:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788521231.454155:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521231.454354:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521231.454361:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788521231.456224:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788521231.456234:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788521231.506858:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521231.507278:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788521231.507285:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788521231.511971:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521231.511989:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788521231.517752:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788521231.518106:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788521231.520597:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788521231.520628:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788521231.520634:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788521231.520755:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788521231.520821:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788521231.520825:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788521231.520827:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521231.520828:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521231.520829:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521231.520830:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521231.520832:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521231.520833:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521231.520834:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521231.520836:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788521231.520837:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788521231.520838:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521231.520840:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788521231.520842:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788521231.520844:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788521231.520845:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521231.520846:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521231.520847:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521231.520848:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521231.520849:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521231.520850:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521231.520851:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521231.520852:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788521231.520853:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788521231.520853:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521231.520854:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788521231.520887:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788521231.520922:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a15ddd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368062720:0@lo:253: 00000100:00100000:1.0:1788521231.520987:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521231.521168:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007f1f7eda going to sleep for 11 seconds 00000100:00100000:3.0:1788521231.521241:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368062720 00000100:00100000:3.0:1788521231.521248:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368062720 00000100:00100000:3.0:1788521231.521292:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521231.521300:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000063ffc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:5814:x1875400368062720:12345-0@lo:253: 20000000:01000000:3.0:1788521231.521342:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788521231.521346:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788521231.521680:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788521231.521744:0:5828:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788521231.522175:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521231.524298:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788521231.524561:0:5828:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788521231.524565:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788521231.524582:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788521231.524585:0:5828:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788521231.524607:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788521231.524847:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521231.525322:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788521231.525336:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788521231.525381:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788521231.525428:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788521231.525464:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788521231.525555:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788521231.525564:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788521231.525623:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788521231.525632:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788521231.525667:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788521231.525673:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788521231.525699:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788521231.525741:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788521231.526556:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788521231.526569:0:5828:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788521231.526600:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521231.527189:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788521231.527205:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788521231.527255:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788521231.527302:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788521231.527351:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788521231.527362:0:5828:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788521231.527444:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788521231.527452:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788521231.527673:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788521231.527718:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788521231.527752:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788521231.527763:0:5828:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788521231.528154:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788521231.528165:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788521231.528196:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788521231.528226:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788521231.528389:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788521231.528441:0:5828:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788521231.528448:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788521231.531460:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788521231.532199:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788521231.532226:0:5828:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.148@tcp for mdt 20000000:01000000:1.0:1788521231.532229:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:1.0:1788521231.532268:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788521231.532276:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788521231.532305:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788521231.532312:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:1.0:1788521231.532353:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788521231.532364:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788521231.532395:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788521231.532429:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788521231.532500:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788521231.532503:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788521231.532508:0:5828:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788521231.532515:0:5828:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788521231.533131:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1788521231.533269:0:5828:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788521231.550240:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788521231.550313:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1788521231.550378:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1788521231.550397:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788521231.550399:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788521231.550403:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788521231.550421:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788521231.550423:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788521231.550452:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788521231.550455:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788521231.556503:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1788521231.557090:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1788521231.557140:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1788521231.557228:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1788521231.557242:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788521231.557244:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788521231.558145:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788521231.558591:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788521231.558635:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788521231.558684:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788521231.558701:0:5828:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521231.558703:0:5828:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788521231.558710:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788521231.558727:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558743:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558754:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558760:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558766:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558973:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558981:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f57e8de2 already unused, calling callback (000000009851ec0d) 00010000:00010000:3.0:1788521231.558984:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.558992:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.559004:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.559142:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.559148:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f57e8de2/0x53df1cebae01603f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788521231.559227:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788521231.889069:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000063ffc53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:5814:x1875400368062720:12345-0@lo:253: Request processed in 367763us (368075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521231.889085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521231.889383:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a15ddd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368062720:0@lo:253: 10000000:01000000:1.0:1788521231.889400:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788521231.889403:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521231.889415:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521231.889416:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521231.889418:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788521231.889419:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521231.889420:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521231.889421:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521231.889423:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521231.889424:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788521231.889426:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521231.889427:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788521231.889446:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000acda23be from lustre-MDT0000 10000000:01000000:1.0:1788521231.889469:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788521231.889472:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788521231.889476:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c0a489a19c0 10000000:01000000:1.0:1788521231.889480:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521231.889488:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0a489a19c0 from 1 10000000:01000000:1.0:1788521231.889491:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788521231.889526:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521231.889537:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521231.889560:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521231.889578:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a15ddd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368062848:0@lo:101: 00000100:00100000:1.0:1788521231.889616:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521231.889673:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c0efbba3 going to sleep for 11 seconds 00000100:00100000:3.0:1788521231.889741:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368062848 00000100:00100000:3.0:1788521231.889748:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368062848 00000100:00100000:3.0:1788521231.889809:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521231.889817:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004890afc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:5814:x1875400368062848:12345-0@lo:101: 00010000:00010000:3.0:1788521231.889829:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521231.889841:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f57e8de2/0x53df1cebae01604d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016046 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.889863:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f57e8de2/0x53df1cebae01604d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016046 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.889873:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f57e8de2/0x53df1cebae01604d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016046 expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.889882:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f57e8de2, rc 0) 00000100:00100000:3.0:1788521231.889925:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004890afc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:5814:x1875400368062848:12345-0@lo:101: Request processed in 109us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521231.889931:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521231.890236:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a15ddd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368062848:0@lo:101: 00010000:00010000:0.0:1788521231.890250:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.890259:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521231.890306:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368062976:0@lo:501: 00000100:00100000:0.0:1788521231.890349:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521231.890379:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc60a37a going to sleep for 11 seconds 00000100:00100000:3.0:1788521231.890436:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368062976 00000100:00100000:3.0:1788521231.890441:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368062976 00000100:00100000:3.0:1788521231.890471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521231.890477:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033f83117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:5814:x1875400368062976:12345-0@lo:501: 00000100:00100000:3.0:1788521231.890902:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033f83117 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:5814:x1875400368062976:12345-0@lo:501: Request processed in 425us (551us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521231.890910:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521231.891111:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368062976:0@lo:501: 10000000:01000000:0.0:1788521231.891140:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788521231.891283:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.891300:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000c422a558/0x53df1cebae016046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521231.891309:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0a4f90d800 10000000:01000000:0.0:1788521231.891313:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788521231.891317:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c0a4f90d800 10000000:01000000:0.0:1788521231.891320:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788521231.891322:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c0a4f90d800 from 1 10000000:01000000:0.0:1788521231.891325:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788521231.891352:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.891360:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.891368:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521231.891381:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063104:0@lo:101: 00000100:00100000:0.0:1788521231.891426:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521231.891458:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc60a37a going to sleep for 11 seconds 00000100:00100000:2.0:1788521231.891553:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063104 00000100:00100000:2.0:1788521231.891559:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063104 00000100:00100000:2.0:1788521231.891611:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521231.891618:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050a8d1b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:5814:x1875400368063104:12345-0@lo:101: 00010000:00010000:2.0:1788521231.891629:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521231.891641:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bce6b984/0x53df1cebae01605b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016054 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521231.891671:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bce6b984/0x53df1cebae01605b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016054 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521231.891680:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bce6b984/0x53df1cebae01605b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016054 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521231.891688:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bce6b984, rc 0) 00000100:00100000:2.0:1788521231.891747:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050a8d1b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+7:5814:x1875400368063104:12345-0@lo:101: Request processed in 130us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521231.891754:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521231.891903:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063104:0@lo:101: 00010000:00010000:0.0:1788521231.891914:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.891922:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521231.891947:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788521231.892122:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.892130:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 0000000096007f63/0x53df1cebae016054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521231.892136:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788521231.892140:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521231.892144:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c0a4f90d800 10000000:01000000:0.0:1788521231.892146:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788521231.892149:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788521231.892152:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521231.892179:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.892187:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.892193:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521231.892204:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063232:0@lo:101: 00000100:00100000:0.0:1788521231.892231:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521231.892257:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc60a37a going to sleep for 11 seconds 00000100:00100000:3.0:1788521231.892368:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063232 00000100:00100000:3.0:1788521231.892373:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063232 00000100:00100000:3.0:1788521231.892414:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521231.892421:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000749e1a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+7:5814:x1875400368063232:12345-0@lo:101: 00010000:00010000:3.0:1788521231.892429:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521231.892437:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000039275c70/0x53df1cebae016069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016062 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.892451:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000039275c70/0x53df1cebae016069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016062 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.892457:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000039275c70/0x53df1cebae016069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016062 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521231.892463:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000039275c70, rc 0) 00000100:00100000:3.0:1788521231.892496:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000749e1a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+8:5814:x1875400368063232:12345-0@lo:101: Request processed in 77us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521231.892503:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521231.892678:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063232:0@lo:101: 00010000:00010000:0.0:1788521231.892689:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521231.892706:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521231.892752:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063360:0@lo:501: 00000100:00100000:0.0:1788521231.892810:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521231.892835:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc60a37a going to sleep for 11 seconds 00000100:00100000:3.0:1788521231.892900:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063360 00000100:00100000:3.0:1788521231.892905:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063360 00000100:00100000:3.0:1788521231.892939:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521231.892945:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000daba96ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+8:5814:x1875400368063360:12345-0@lo:501: 00000100:00100000:3.0:1788521231.893204:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000daba96ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5814:x1875400368063360:12345-0@lo:501: Request processed in 259us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521231.893212:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521231.893551:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000049b991c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063360:0@lo:501: 00000100:00100000:2.0:1788521231.893602:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000223c8893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063488:0@lo:503: 00000100:00100000:2.0:1788521231.893639:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521231.893667:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000009ee25e02 going to sleep for 11 seconds 00000100:00100000:0.0:1788521231.893732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063488 00000100:00100000:0.0:1788521231.893737:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063488 00000100:00100000:0.0:1788521231.893792:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521231.893798:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077c9aa5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5814:x1875400368063488:12345-0@lo:503: 00000100:00100000:0.0:1788521231.893947:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077c9aa5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5814:x1875400368063488:12345-0@lo:503: Request processed in 149us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521231.893953:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521231.894043:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000223c8893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063488:0@lo:503: 00000100:00100000:3.0:1788521231.895248:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5855:1875400368063616:0@lo:502: 00000100:00100000:3.0:1788521231.895316:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521231.895392:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e4153eb going to sleep for 11 seconds 00000100:00100000:0.0:1788521231.895586:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063616 00000100:00100000:0.0:1788521231.895593:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063616 00000100:00100000:0.0:1788521231.895671:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521231.895678:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066b4c5ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5855:x1875400368063616:12345-0@lo:502: 00000100:00100000:0.0:1788521231.895951:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066b4c5ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5855:x1875400368063616:12345-0@lo:502: Request processed in 273us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521231.895959:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521231.896246:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5855:1875400368063616:0@lo:502: 00000020:01000000:3.0:1788521231.896275:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521231.896285:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521231.896287:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788521231.896291:0:5855:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788521231.896294:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521231.896306:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000120b3dee) 00000020:00000080:3.0:1788521231.896322:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788521231.896326:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788521231.896401:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788521231.896520:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae016077 00000020:00000080:3.0:1788521231.896727:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788521231.896732:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521231.896735:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521231.896736:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788521231.896739:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521231.896743:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521231.896744:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788521231.896747:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521231.896753:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000af688c05) 00000020:00000080:3.0:1788521231.896762:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788521231.896765:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788521231.896766:0:5855:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788521231.896769:0:5855:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788521231.896906:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521231.896957:0:5855:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000acda23be from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788521231.896968:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001dda8f5c) 00000020:00000080:3.0:1788521231.896976:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788521231.897097:0:5855:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788521231.897102:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae01608c 00000020:00000080:3.0:1788521231.897320:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788521231.897328:0:5855:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788521231.897333:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x53df1cebae016093 00080000:01000000:3.0:1788521231.897338:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788521231.897342:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae01609a 00080000:10000000:3.0:1788521231.898324:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788521231.898754:0:5855:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788521231.904543:0:5855:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788521232.026692:0:5855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788521232.027313:0:5855:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788521232.032334:0:5855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788521232.032633:0:5855:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788521232.085454:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009159464d) 00000020:00000080:3.0:1788521232.085476:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788521232.085541:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788521232.085546:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0160a8 00000020:00000080:2.0:1788521232.088303:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788521232.091105:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521232.213085:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521232.269811:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.341492:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788521232.362294:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788521232.397825:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.446951:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788521232.510957:0:5855:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x53df1cebae0160af 00000020:00000080:3.0:1788521232.511397:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788521232.511406:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521232.511412:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521232.511414:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788521232.511417:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521232.511423:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521232.511424:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788521232.511428:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788521232.511462:0:5855:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788521232.511475:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521232.511478:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521232.511479:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788521232.511481:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521232.511484:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521232.511485:0:5855:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521232.511487:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521232.511495:0:5855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788521232.511546:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5855:1875400368063744:0@lo:502: 00000100:00100000:3.0:1788521232.511614:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521232.511662:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e4153eb going to sleep for 11 seconds 00000100:00100000:1.0:1788521232.511756:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063744 00000100:00100000:1.0:1788521232.511763:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063744 00000100:00100000:1.0:1788521232.511817:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521232.511824:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f75393e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5855:x1875400368063744:12345-0@lo:502: 00000100:00100000:1.0:1788521232.512115:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f75393e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5855:x1875400368063744:12345-0@lo:502: Request processed in 291us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521232.512123:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521232.512286:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5855:1875400368063744:0@lo:502: 00000020:01000000:3.0:1788521232.512309:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521232.512314:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521232.512316:0:5855:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788521232.512319:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788521232.512454:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788521232.512474:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788521232.512492:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521232.512603:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000df96705e/0x53df1cebae016062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521232.512611:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c0a4f90d800 from 1 10000000:01000000:2.0:1788521232.512614:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788521232.512637:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521232.512644:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521232.512652:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521232.512664:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000223c8893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063872:0@lo:101: 00000100:00100000:2.0:1788521232.512692:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521232.512721:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec96cdc5 going to sleep for 11 seconds 00000100:00100000:3.0:1788521232.512769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368063872 00000100:00100000:3.0:1788521232.512800:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368063872 00000100:00100000:3.0:1788521232.512824:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521232.512829:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c02abb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:5814:x1875400368063872:12345-0@lo:101: 00010000:00010000:3.0:1788521232.512838:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521232.512847:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0160b6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.512866:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.512875:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.512892:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000031bc5b6b, rc 0) 00000100:00100000:3.0:1788521232.512924:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c02abb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:5814:x1875400368063872:12345-0@lo:101: Request processed in 95us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521232.512930:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521232.513027:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000223c8893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368063872:0@lo:101: 00010000:00010000:2.0:1788521232.513037:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521232.513046:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521232.513656:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000223c8893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064000:0@lo:256: 00000100:00100000:2.0:1788521232.513692:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521232.513719:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec96cdc5 going to sleep for 11 seconds 00000100:00100000:3.0:1788521232.513893:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064000 00000100:00100000:3.0:1788521232.513899:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064000 00000100:00100000:3.0:1788521232.513928:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521232.513934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ff99f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:5814:x1875400368064000:12345-0@lo:256: 20000000:01000000:3.0:1788521232.513947:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788521232.513953:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788521232.514182:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ff99f77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:5814:x1875400368064000:12345-0@lo:256: Request processed in 248us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521232.514190:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521232.514305:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000223c8893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064000:0@lo:256: 10000000:01000000:1.0:1788521232.515119:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521232.515170:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.515180:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521232.515188:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a4f90d800 from 1 10000000:01000000:1.0:1788521232.515191:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521232.515217:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.515231:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.515239:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521232.515252:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a86fafc pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064128:0@lo:101: 00000100:00100000:1.0:1788521232.515287:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521232.515319:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d64ae3e going to sleep for 11 seconds 00000100:00100000:3.0:1788521232.515358:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064128 00000100:00100000:3.0:1788521232.515363:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064128 00000100:00100000:3.0:1788521232.515397:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521232.515402:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0ad474a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:5814:x1875400368064128:12345-0@lo:101: 00010000:00010000:3.0:1788521232.515411:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521232.515420:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0160c4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.515437:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.515446:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.515453:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1df0c12, rc 0) 00000100:00100000:3.0:1788521232.515489:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0ad474a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368064128:12345-0@lo:101: Request processed in 86us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521232.515495:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521232.515652:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a86fafc pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064128:0@lo:101: 00010000:00010000:1.0:1788521232.515662:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.515670:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521232.515710:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a86fafc pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064256:0@lo:501: 00000100:00100000:1.0:1788521232.515730:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521232.515749:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d64ae3e going to sleep for 11 seconds 00000100:00100000:3.0:1788521232.515801:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064256 00000100:00100000:3.0:1788521232.515805:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064256 00000100:00100000:3.0:1788521232.515825:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521232.515830:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be7a50bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368064256:12345-0@lo:501: 00000100:00100000:3.0:1788521232.516465:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be7a50bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368064256:12345-0@lo:501: Request processed in 634us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521232.516472:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521232.516708:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a86fafc pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064256:0@lo:501: 00000100:00100000:1.0:1788521232.516734:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005a86fafc pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064384:0@lo:503: 00000100:00100000:1.0:1788521232.516768:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521232.516895:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000007d64ae3e going to sleep for 11 seconds 00000100:00100000:2.0:1788521232.516953:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064384 00000100:00100000:2.0:1788521232.516958:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064384 00000100:00100000:2.0:1788521232.517073:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788521232.517080:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc099a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368064384:12345-0@lo:503: 00000040:00080000:2.0:1788521232.517112:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521232.517160:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc099a7a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368064384:12345-0@lo:503: Request processed in 81us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521232.517167:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521232.517222:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005a86fafc pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064384:0@lo:503: 00000040:00080000:3.0:1788521232.518147:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788521232.518297:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788521232.518325:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521232.518346:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.518355:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521232.518393:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521232.518396:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0a4f90d800 10000000:01000000:0.0:1788521232.518399:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0a4f90d800 10000000:01000000:0.0:1788521232.518402:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521232.518407:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a4f90d800 from 1 10000000:01000000:0.0:1788521232.518410:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521232.518436:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.518443:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.518452:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521232.518467:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064512:0@lo:101: 00000100:00100000:0.0:1788521232.518604:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521232.518769:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061f423b2 going to sleep for 11 seconds 00000100:00100000:1.0:1788521232.518915:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064512 00000100:00100000:1.0:1788521232.518922:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064512 00000100:00100000:1.0:1788521232.518951:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521232.518963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026d50820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368064512:12345-0@lo:101: 00010000:00010000:1.0:1788521232.518975:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521232.518987:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006cd5afaa/0x53df1cebae0160d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0160d2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.519018:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006cd5afaa/0x53df1cebae0160d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.519027:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006cd5afaa/0x53df1cebae0160d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521232.519034:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006cd5afaa, rc 0) 00000100:00100000:1.0:1788521232.519110:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026d50820 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5814:x1875400368064512:12345-0@lo:101: Request processed in 147us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521232.519116:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521232.519280:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064512:0@lo:101: 00010000:00010000:0.0:1788521232.519292:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.519300:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521232.519348:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064640:0@lo:501: 00000100:00100000:0.0:1788521232.519371:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521232.519429:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061f423b2 going to sleep for 11 seconds 00000100:00100000:1.0:1788521232.519464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064640 00000100:00100000:1.0:1788521232.519468:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064640 00000100:00100000:1.0:1788521232.519583:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521232.519589:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ac6cde2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5814:x1875400368064640:12345-0@lo:501: 00000100:00100000:1.0:1788521232.519849:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ac6cde2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5814:x1875400368064640:12345-0@lo:501: Request processed in 260us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521232.519856:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521232.519983:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064640:0@lo:501: 00000100:00100000:0.0:1788521232.520064:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064768:0@lo:503: 00000100:00100000:0.0:1788521232.520097:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521232.520148:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061f423b2 going to sleep for 11 seconds 00000100:00100000:1.0:1788521232.520181:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064768 00000100:00100000:1.0:1788521232.520185:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064768 00000100:00100000:1.0:1788521232.520238:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521232.520244:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0bcc944 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5814:x1875400368064768:12345-0@lo:503: 00000100:00100000:1.0:1788521232.520580:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0bcc944 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5814:x1875400368064768:12345-0@lo:503: Request processed in 335us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521232.520595:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521232.520661:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368064768:0@lo:503: 00000100:00100000:0.0:1788521232.520863:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5861:1875400368064896:0@lo:502: 00000100:00100000:0.0:1788521232.520904:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521232.521107:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d987fe6 going to sleep for 11 seconds 00000100:00100000:2.0:1788521232.521158:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368064896 00000100:00100000:2.0:1788521232.521162:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368064896 00000100:00100000:2.0:1788521232.521183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521232.521188:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008387c8b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5861:x1875400368064896:12345-0@lo:502: 00000100:00100000:2.0:1788521232.521366:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008387c8b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5861:x1875400368064896:12345-0@lo:502: Request processed in 178us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521232.521373:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521232.521446:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5861:1875400368064896:0@lo:502: 00000020:01000004:0.0:1788521232.521496:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788521232.521519:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e775e9c1) 00000020:00000080:0.0:1788521232.521535:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788521232.521597:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000acda23be from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521232.521600:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000acda23be from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788521232.521602:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000acda23be 4 00010000:00080000:0.0:1788521232.521626:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ec782e5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1788521232.523189:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788521232.523367:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788521232.523395:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521232.523404:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x53df1cebae0160e7 00000100:00080000:0.0:1788521232.523411:0:5861:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521232.523415:0:5861:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004ec782e5 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521232.523447:0:5861:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000069261c84 x1875400368065024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521232.523475:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788521232.525759:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368065024:0@lo:38: 00000100:00100000:0.0:1788521232.525845:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521232.525956:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065024 00000100:00100000:2.0:1788521232.525963:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065024 00000100:00100000:1.0:1788521232.526179:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5861:1875400368065152:0@lo:502: 00000100:00100000:1.0:1788521232.526224:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521232.526245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065152 00000100:00100000:1.0:1788521232.526248:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065152 00000100:00100000:1.0:1788521232.526271:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788521232.526278:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080854f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5861:x1875400368065152:12345-0@lo:502: 00000100:00100000:1.0:1788521232.526459:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080854f30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5861:x1875400368065152:12345-0@lo:502: Request processed in 181us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521232.526466:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521232.526587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521232.526592:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fff34227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875400368065024:12345-0@lo:38: 00000100:00100000:2.0:1788521232.526636:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fff34227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875400368065024:12345-0@lo:38: Request processed in 43us (792us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788521232.526642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788521232.526711:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce530b9d going to sleep for 11 seconds 00000100:00100000:1.0:1788521232.526728:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:5861:1875400368065152:0@lo:502: 00000040:00080000:1.0:1788521232.526750:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1788521232.528653:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521232.528662:0:3299:0:(import.c:65:import_set_state_nolock()) 000000004ec782e5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521232.528668:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788521232.528671:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000069261c84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368065024:0@lo:38: 00000020:01000000:0.0:1788521232.529171:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788521232.529196:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521232.529214:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.529226:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 0000000008679f45/0x53df1cebae0160d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788521232.529273:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788521232.529275:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521232.529277:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521232.529278:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521232.529279:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521232.529280:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521232.529282:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521232.529283:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521232.529284:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521232.529285:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521232.529287:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521232.529288:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521232.529291:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788521232.529293:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521232.529294:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521232.529295:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521232.529296:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521232.529297:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521232.529298:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521232.529299:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521232.529300:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521232.529305:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521232.529306:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521232.529307:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521232.529307:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521232.529327:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788521232.529338:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e7a5ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368065280:0@lo:253: 00000100:00100000:0.0:1788521232.529386:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521232.529415:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set 000000008dd895fa going to sleep for 11 seconds 00000100:00100000:0.0:1788521232.529852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065280 00000100:00100000:0.0:1788521232.529859:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065280 00000100:00100000:0.0:1788521232.529908:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521232.529915:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009120bd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5814:x1875400368065280:12345-0@lo:253: 20000000:01000000:0.0:1788521232.529951:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788521232.529963:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788521232.559598:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788521232.559619:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788521232.559722:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788521232.559727:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788521232.559745:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.559764:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.559800:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.559839:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.559854:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 12 pid: 5828 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521232.559866:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875400368065408:0@lo:104: 00000100:00100000:3.0:1788521232.559935:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521232.559975:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022113f8c going to sleep for 11 seconds 00000100:00100000:0.0:1788521232.560041:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065408 00000100:00100000:0.0:1788521232.560049:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065408 00000100:00100000:0.0:1788521232.560096:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521232.560105:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029228482 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5848:x1875400368065408:12345-0@lo:104: 00010000:00010000:0.0:1788521232.560117:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560170:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521232.560175:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029228482 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5848:x1875400368065408:12345-0@lo:104: Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521232.560181:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788521232.560200:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521232.560205:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560212:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dff8df85 already unused, calling callback (00000000a0ec80e2) 10000000:00010000:0.0:1788521232.560229:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560236:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521232.560242:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521232.560247:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521232.560271:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560277:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521232.560291:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560298:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000dff8df85/0x53df1cebae0160b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160bd expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560312:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521232.560314:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521232.560315:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521232.560364:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcbd6b2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368065536:0@lo:103: 00000100:00100000:0.0:1788521232.560390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521232.560446:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065536 00000100:00100000:0.0:1788521232.560450:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065536 00010000:00010000:0.0:1788521232.560465:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 13 pid: 5828 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521232.560486:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521232.560498:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065037a95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3301:x1875400368065536:12345-0@lo:103: 00010000:00010000:0.0:1788521232.560508:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521232.560512:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 13 pid: 5828 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560521:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 13 pid: 5828 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560534:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560542:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521232.560554:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000827604s 00010000:00010000:0.0:1788521232.560557:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560562:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560568:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560573:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560578:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000091e9c879 already unused, calling callback (000000009851ec0d) 00010000:00010000:0.0:1788521232.560581:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560588:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560605:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521232.560614:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521232.560641:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065037a95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3301:x1875400368065536:12345-0@lo:103: Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521232.560647:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521232.560681:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcbd6b2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368065536:0@lo:103: 00010000:00010000:3.0:1788521232.560830:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000031bc5b6b/0x53df1cebae0160bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0160b6 expref: 12 pid: 5828 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521232.560841:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875400368065408:0@lo:104: 00010000:00010000:3.0:1788521232.560859:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.560866:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.560871:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521232.560876:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091e9c879/0x53df1cebae0160ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521232.569129:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009120bd1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5814:x1875400368065280:12345-0@lo:253: Request processed in 39205us (39734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521232.569145:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521232.569227:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e7a5ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:5814:1875400368065280:0@lo:253: 10000000:01000000:0.0:1788521232.569243:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788521232.569246:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788521232.569248:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788521232.569249:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521232.569250:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521232.569252:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521232.569253:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521232.569254:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788521232.569255:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788521232.569257:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521232.569258:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521232.569260:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521232.569261:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788521232.569276:0:5814:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788521232.576987:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.577375:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521232.577698:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.577987:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521232.578255:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.578906:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521232.579627:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.579849:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521232.580091:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.580257:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788521232.580483:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788521232.580658:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788521232.637583:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788521232.679288:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788521232.679316:0:5866:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788521232.679321:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788521232.679914:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788521232.704743:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788521232.709048:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788521232.709599:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788521232.709612:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788521232.709845:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521232.711812:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788521232.718077:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788521232.718151:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788521232.718942:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788521232.719150:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788521232.722831:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788521232.723008:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788521232.725978:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788521232.726174:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788521232.726545:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788521232.727008:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788521232.727157:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788521232.727558:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788521232.727742:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788521232.727955:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788521232.728102:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788521232.728254:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788521232.728683:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788521232.728872:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788521232.729129:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788521232.729298:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788521232.729725:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788521232.729916:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788521232.730051:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788521232.730194:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788521232.730343:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788521232.731000:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788521232.731155:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788521232.734817:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788521232.735081:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788521232.735236:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788521232.740326:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788521232.741944:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788521232.742124:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788521232.742308:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788521232.742460:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788521232.742634:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788521232.742833:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788521232.752217:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788521232.808664:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788521232.808698:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb00781cc7988 00100000:10000000:3.0:1788521232.808814:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788521232.809580:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788521232.809595:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788521232.809608:0:5814:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788521232.809633:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788521232.857046:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788521232.857127:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788521232.857132:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788521233.385920:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521234.412483:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521235.432956:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521236.457952:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521237.404434:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788521237.481397:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521237.617817:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788521237.617833:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788521237.617836:0:38:0:(import.c:65:import_set_state_nolock()) 000000004ec782e5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521237.617859:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004ec782e5 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1788521237.617881:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009ee291f3 x1875400368065792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521237.617916:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ee291f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368065792:0@lo:38: 00000100:00100000:1.0:1788521237.618042:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521237.618071:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065792 00000100:00100000:2.0:1788521237.618079:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065792 00000100:00100000:2.0:1788521237.618133:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521237.618139:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1cd2d4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875400368065792:12345-0@lo:38: 00010000:00080000:2.0:1788521237.618162:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:2.0:1788521237.618203:0:5834:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x53df1cebae0160f5 00000004:00100000:2.0:1788521237.618240:0:5834:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788521237.618389:0:5834:0:(import.c:65:import_set_state_nolock()) 000000003545d794 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521237.618449:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1cd2d4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875400368065792:12345-0@lo:38: Request processed in 308us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521237.618457:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521237.618636:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009ee291f3 x1875400368065792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788521237.618650:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788521237.618656:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788521237.618660:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788521237.618661:0:3299:0:(import.c:65:import_set_state_nolock()) 000000004ec782e5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788521237.618666:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ee291f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368065792:0@lo:38: 00000100:00100000:1.0:1788521237.618889:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368065664:0@lo:400: 00000100:00100000:1.0:1788521237.618920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521237.618991:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065664 00000100:00100000:3.0:1788521237.618997:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065664 00000100:00100000:3.0:1788521237.619033:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788521237.619038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2dafe70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:3302:x1875400368065664:12345-0@lo:400: 00000100:00100000:3.0:1788521237.619072:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2dafe70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:3302:x1875400368065664:12345-0@lo:400: Request processed in 35us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521237.619078:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521237.619162:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368065664:0@lo:400: 10000000:01000000:0.0:1788521237.619445:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521237.619449:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c0a4f90d800 from 3 10000000:01000000:0.0:1788521237.619452:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521237.619483:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521237.619492:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521237.619500:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521237.619514:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008e7a5ac8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368065920:0@lo:101: 00000100:00100000:0.0:1788521237.619539:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521237.619592:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077ed14ff going to sleep for 11 seconds 00000100:00100000:1.0:1788521237.624344:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368065920 00000100:00100000:1.0:1788521237.624360:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368065920 00000100:00100000:1.0:1788521237.624413:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521237.624421:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000821767db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5830:x1875400368065920:12345-0@lo:101: 00010000:00010000:1.0:1788521237.624437:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521237.624455:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061598b9d/0x53df1cebae016103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0160fc expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521237.624501:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061598b9d/0x53df1cebae016103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0160fc expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521237.624511:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061598b9d/0x53df1cebae016103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160fc expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521237.624520:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061598b9d, rc 0) 00000100:00100000:1.0:1788521237.624594:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000821767db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368065920:12345-0@lo:101: Request processed in 174us (5054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521237.624601:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521237.625263:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008e7a5ac8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368065920:0@lo:101: 00010000:00010000:1.0:1788521237.625283:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521237.625292:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521237.625410:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066048:0@lo:256: 00000100:00100000:1.0:1788521237.625454:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521237.625497:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 00000000423eeb31 going to sleep for 11 seconds 00000100:00100000:3.0:1788521237.625548:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066048 00000100:00100000:3.0:1788521237.625555:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066048 00000100:00100000:3.0:1788521237.625594:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521237.625602:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf0f0f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066048:12345-0@lo:256: 20000000:01000000:3.0:1788521237.625619:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788521237.625635:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788521237.625638:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788521237.625768:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf0f0f61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066048:12345-0@lo:256: Request processed in 167us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521237.625797:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521237.625988:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066048:0@lo:256: 10000000:01000000:1.0:1788521237.626026:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521237.626032:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521237.626039:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000275dd8a4/0x53df1cebae0160fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521238.505055:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521239.529336:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521240.554296:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521241.578124:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788521242.293328:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5aa30cd0 20000000:00000080:3.0:1788521242.293352:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c0a45641400 uarg=0000000000000000 20000000:01000000:3.0:1788521242.293395:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788521242.293404:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788521242.293411:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788521242.299949:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788521242.299967:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788521242.305064:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521242.305639:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788521242.305689:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788521242.306951:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788521242.306977:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788521242.306995:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.307014:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.307036:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.307087:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.307102:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 11 pid: 5825 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521242.307113:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875400368066176:0@lo:104: 00000100:00100000:3.0:1788521242.307179:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521242.307230:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 0000000099ff39ef going to sleep for 11 seconds 00000100:00100000:0.0:1788521242.307255:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066176 00000100:00100000:0.0:1788521242.307273:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066176 00000100:00100000:0.0:1788521242.307649:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521242.307661:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5d19e8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:6311:x1875400368066176:12345-0@lo:104: 00010000:00010000:0.0:1788521242.307680:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521242.307808:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521242.307822:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5d19e8b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:6311:x1875400368066176:12345-0@lo:104: Request processed in 156us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521242.307831:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788521242.307908:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521242.307916:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.307925:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000aff16f0c already unused, calling callback (00000000a0ec80e2) 10000000:00010000:1.0:1788521242.307928:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.307937:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521242.307943:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521242.307948:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521242.307996:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.308003:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521242.308026:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.308032:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000aff16f0c/0x53df1cebae0160c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160cb expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.308054:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521242.308056:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521242.308058:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000042b0887f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1875400368066176:0@lo:104: 00010000:00010000:1.0:1788521242.308060:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521242.308089:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521242.309351:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521242.309373:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368066304:0@lo:103: 00000100:00100000:1.0:1788521242.309431:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521242.309507:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066304 00000100:00100000:3.0:1788521242.309518:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066304 00010000:00010000:3.0:1788521242.309555:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 12 pid: 5825 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521242.309601:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521242.309610:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ee291f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3302:x1875400368066304:12345-0@lo:103: 00010000:00010000:3.0:1788521242.309626:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521242.309631:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 12 pid: 5825 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309642:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 12 pid: 5825 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309673:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1df0c12/0x53df1cebae0160cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0160c4 expref: 12 pid: 5825 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309692:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309701:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309715:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309722:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309728:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309735:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309741:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000369508d2 already unused, calling callback (000000009851ec0d) 00010000:00010000:3.0:1788521242.309745:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309752:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309769:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.309832:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.309850:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521242.309859:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000369508d2/0x53df1cebae01610a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521242.309861:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521242.309929:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ee291f3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:3302:x1875400368066304:12345-0@lo:103: Request processed in 320us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521242.309937:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521242.309983:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007025d39f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368066304:0@lo:103: 00010000:00010000:3.0:1788521242.601176:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521242.729683:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521242.729719:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcbd6b2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368066432:0@lo:400: 00000100:00100000:3.0:1788521242.729971:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521242.730197:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066432 00000100:00100000:0.0:1788521242.730209:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066432 00000100:00100000:0.0:1788521242.730285:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521242.730295:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042b0887f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368066432:12345-0@lo:400: 00000100:00100000:0.0:1788521242.732547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042b0887f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368066432:12345-0@lo:400: Request processed in 2240us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521242.732567:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788521242.741867:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fcbd6b2e x1875400368066432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521242.741896:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcbd6b2e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368066432:0@lo:400: 00010000:00010000:0.0:1788521243.626144:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521244.651471:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521244.780598:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521244.780609:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a4f90d800 from 1 10000000:01000000:0.0:1788521244.780616:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521244.780671:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c32d9e42/0x53df1cebae016111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521244.780686:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000c32d9e42/0x53df1cebae016111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521244.780699:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000c32d9e42/0x53df1cebae016111 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521244.780900:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c1b73e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066560:0@lo:101: 00000100:00100000:0.0:1788521244.780988:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521244.781052:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022113f8c going to sleep for 11 seconds 00000100:00100000:2.0:1788521244.785369:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066560 00000100:00100000:2.0:1788521244.785390:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066560 00000100:00100000:2.0:1788521244.785471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521244.785481:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006392d31c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:5830:x1875400368066560:12345-0@lo:101: 00010000:00010000:2.0:1788521244.785505:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521244.785531:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000009a28cb9/0x53df1cebae016118 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016111 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521244.785659:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000009a28cb9/0x53df1cebae016118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016111 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521244.785675:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000009a28cb9/0x53df1cebae016118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016111 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521244.785685:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000009a28cb9, rc 0) 00000100:00100000:2.0:1788521244.785822:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006392d31c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066560:12345-0@lo:101: Request processed in 342us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521244.785830:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788521244.785872:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c1b73e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066560:0@lo:101: 00010000:00010000:0.0:1788521244.785897:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000c32d9e42/0x53df1cebae016111 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521244.785909:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000c32d9e42/0x53df1cebae016111 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521244.786001:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c1b73e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066688:0@lo:501: 00000100:00100000:0.0:1788521244.786051:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521244.786097:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066688 00000100:00100000:3.0:1788521244.786103:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066688 00000100:00100000:0.0:1788521244.786105:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022113f8c going to sleep for 11 seconds 00000100:00100000:3.0:1788521244.786144:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521244.786151:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063d539f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066688:12345-0@lo:501: 00000100:00100000:3.0:1788521244.786940:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063d539f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066688:12345-0@lo:501: Request processed in 620us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521244.786950:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788521244.787326:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c1b73e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066688:0@lo:501: 00000100:00100000:0.0:1788521244.787469:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c1b73e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066816:0@lo:503: 00000100:00100000:0.0:1788521244.787522:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521244.787599:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set 0000000022113f8c going to sleep for 11 seconds 00000100:00100000:2.0:1788521244.787693:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066816 00000100:00100000:2.0:1788521244.787700:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066816 00000100:00100000:3.0:1788521244.787755:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521244.787764:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c577d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066816:12345-0@lo:503: 00000100:00100000:3.0:1788521244.788153:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c577d58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368066816:12345-0@lo:503: Request processed in 389us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521244.788160:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521244.788269:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c1b73e6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368066816:0@lo:503: 00000100:00100000:3.0:1788521244.789689:0:6404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000000a762ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6404:1875400368066944:0@lo:502: 00000100:00100000:3.0:1788521244.789768:0:6404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521244.790016:0:6404:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061251840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521244.790847:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368066944 00000100:00100000:1.0:1788521244.790859:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368066944 00000100:00100000:1.0:1788521244.790919:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521244.790929:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020575b59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6404:x1875400368066944:12345-0@lo:502: 00000100:00100000:1.0:1788521244.791893:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020575b59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6404:x1875400368066944:12345-0@lo:502: Request processed in 960us (2119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521244.791905:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521244.792253:0:6404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000000a762ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6404:1875400368066944:0@lo:502: 00000020:01000000:3.0:1788521244.792301:0:6404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521244.792314:0:6404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521244.792317:0:6404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788521244.792325:0:6404:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a4f90d800 00000020:00000080:3.0:1788521244.792328:0:6404:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521244.792469:0:6404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6404:1875400368067072:0@lo:502: 00000100:00100000:3.0:1788521244.792525:0:6404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521244.792569:0:6404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521244.792594:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067072 00000100:00100000:2.0:1788521244.792602:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067072 00000100:00100000:2.0:1788521244.792641:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521244.792657:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6404:x1875400368067072:12345-0@lo:502: 00000100:00100000:2.0:1788521244.792878:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6404:x1875400368067072:12345-0@lo:502: Request processed in 222us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521244.792885:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788521244.793322:0:6404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6404:1875400368067072:0@lo:502: 00000020:01000000:3.0:1788521244.793472:0:6404:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521244.793480:0:6404:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521244.793482:0:6404:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788521244.793486:0:6404:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788521244.793889:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788521244.793914:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521244.793927:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521244.793939:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521245.674732:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521246.698656:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521247.726064:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521247.849165:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368067328:0@lo:400: 00000100:00100000:3.0:1788521247.849232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521247.849308:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067328 00000100:00100000:3.0:1788521247.849315:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067328 00000100:00100000:3.0:1788521247.849359:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521247.849369:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368067328:12345-0@lo:400: 00000100:00100000:3.0:1788521247.849418:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368067328:12345-0@lo:400: Request processed in 51us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521247.849425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521247.849462:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0a75d19f80 x1875400368067328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521247.849490:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368067328:0@lo:400: 00000100:00100000:1.0:1788521247.849545:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521247.849555:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368067200:0@lo:400: 00000100:00100000:1.0:1788521247.849596:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521247.855493:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067200 00000100:00100000:3.0:1788521247.855507:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067200 00000100:00100000:3.0:1788521247.855572:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521247.855582:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3300:x1875400368067200:12345-0@lo:400: 00000100:00100000:3.0:1788521247.855677:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3300:x1875400368067200:12345-0@lo:400: Request processed in 96us (6079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521247.855684:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521247.856207:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368067200:0@lo:400: 00010000:00010000:1.0:1788521248.745281:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788521249.063044:0:6688:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788521249.063048:0:6688:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788521249.063186:0:6688:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c0a75d22000 00000020:01000004:3.0:1788521249.063202:0:6688:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788521249.063214:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788521249.063227:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c0a7b9f19c0) 00000020:00000080:3.0:1788521249.063242:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788521249.118737:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788521249.124621:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788521249.191828:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788521249.218049:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788521249.218098:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788521249.218177:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788521249.218217:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788521249.218574:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788521249.218584:0:6688:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788521249.218595:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x53df1cebae016126 00000020:01000004:3.0:1788521249.218602:0:6688:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788521249.218622:0:6688:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788521249.218625:0:6688:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788521249.218631:0:6688:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788521249.218635:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788521249.218654:0:6688:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c0a7b9f0000) 00000020:00000080:3.0:1788521249.218664:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788521249.219706:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521249.219889:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788521249.219895:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788521249.227058:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521249.227071:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788521249.229477:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521249.229490:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788521249.232308:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521249.232491:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788521249.232497:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788521249.234213:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788521249.234223:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788521249.286727:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521249.287210:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788521249.287218:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788521249.291880:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521249.291901:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788521249.294140:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788521249.294175:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788521249.302404:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521249.303010:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521249.303024:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788521249.304116:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788521249.304124:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788521249.411698:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521249.413809:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788521249.413817:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788521249.416814:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788521249.416827:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788521249.417293:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788521249.417318:0:6688:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788521249.417324:0:6688:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788521249.502734:0:6688:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788521249.502810:0:6688:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788521249.502814:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788521249.502816:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788521249.502818:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521249.502819:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521249.502826:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521249.502828:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521249.502829:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521249.502830:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521249.502832:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521249.502834:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521249.502835:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521249.502839:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788521249.502841:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521249.502843:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788521249.502844:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521249.502845:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521249.502846:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521249.502847:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521249.502848:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521249.502849:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521249.502850:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521249.502851:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521249.502852:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521249.502879:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788521249.502898:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368067456:0@lo:253: 00000100:00100000:0.0:1788521249.502968:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.503024:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.503626:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067456 00000100:00100000:2.0:1788521249.503635:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067456 00000100:00100000:2.0:1788521249.503685:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521249.503695:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368067456:12345-0@lo:253: 20000000:01000000:2.0:1788521249.503727:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788521249.503730:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788521249.503736:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788521249.503739:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788521249.504877:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521249.505154:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1788521249.505167:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788521249.505200:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1788521249.505207:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788521249.505230:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1788521249.505269:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788521249.505846:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788521249.505867:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:2.0:1788521249.505869:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:2.0:1788521249.506035:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788521249.506044:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788521249.506087:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788521249.506101:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:2.0:1788521249.506140:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788521249.506149:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788521249.506174:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788521249.506223:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788521249.510208:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788521249.510238:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:2.0:1788521249.510240:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:2.0:1788521249.510286:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788521249.510295:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788521249.510326:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788521249.510333:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:2.0:1788521249.510378:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788521249.510390:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788521249.510419:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788521249.510449:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788521249.510466:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788521249.510469:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788521249.510475:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788521249.510476:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788521249.510491:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788521249.510503:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788521249.510505:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788521249.510537:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788521249.510540:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788521249.511156:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788521249.511603:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788521249.511646:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788521249.511721:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1788521249.511737:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788521249.511740:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788521249.513904:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788521249.513985:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788521249.514048:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788521249.515513:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788521249.515563:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788521249.515888:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788521249.515905:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788521249.515908:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521249.519290:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521249.519380:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521249.519432:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788521249.519753:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788521249.522090:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788521249.522144:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1788521249.522169:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788521249.522190:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522209:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522218:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016062 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522225:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522234:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522274:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522608:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 12 pid: 5825 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.522644:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368067584:0@lo:104: 00000100:00100000:1.0:1788521249.522708:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521249.522803:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016062 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.522812:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016062 expref: 12 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.522817:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067584 00000100:00100000:1.0:1788521249.522820:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368067712:0@lo:104: 00000100:00100000:0.0:1788521249.522824:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067584 00000100:00100000:1.0:1788521249.522842:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521249.522866:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.522871:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067712 00000100:00100000:0.0:1788521249.522873:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067712 00010000:00010000:1.0:1788521249.522874:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.522881:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368067840:0@lo:104: 00000100:00100000:0.0:1788521249.522888:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521249.522897:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:5825:x1875400368067584:12345-0@lo:104: 00010000:00010000:0.0:1788521249.522909:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.522961:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521249.522968:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:5825:x1875400368067584:12345-0@lo:104: Request processed in 72us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.522984:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521249.523001:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521249.523007:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5825:x1875400368067712:12345-0@lo:104: 00010000:00010000:0.0:1788521249.523016:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523053:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788521249.523059:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5825:x1875400368067712:12345-0@lo:104: Request processed in 53us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.523065:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788521249.523093:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521249.523099:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523107:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521249.523111:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523121:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521249.523129:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.523135:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521249.523161:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523168:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521249.523189:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523197:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae0160d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0160d9 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523210:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521249.523213:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523219:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521249.523222:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523229:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521249.523236:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.523242:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521249.523254:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523260:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521249.523273:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523279:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016069 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523289:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.523298:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.523300:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521249.523313:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368068096:0@lo:103: 00000100:00100000:0.0:1788521249.523340:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.523398:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068096 00000100:00100000:0.0:1788521249.523402:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068096 00010000:00010000:0.0:1788521249.523418:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016062 expref: 13 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.523438:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521249.523444:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3300:x1875400368068096:12345-0@lo:103: 00010000:00010000:0.0:1788521249.523468:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521249.523473:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016062 expref: 13 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523483:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016062 expref: 13 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523497:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521249.523524:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3300:x1875400368068096:12345-0@lo:103: Request processed in 81us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.523531:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521249.523561:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368068096:0@lo:103: 00000100:00100000:1.0:1788521249.523579:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.523594:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067840 00000100:00100000:1.0:1788521249.523595:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.523597:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067840 00000100:00100000:1.0:1788521249.523606:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368067584:0@lo:104: 00010000:00010000:1.0:1788521249.523614:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0800/0x53df1cebae016069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016062 expref: 12 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.523624:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368067712:0@lo:104: 00000100:00100000:0.0:1788521249.523633:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521249.523639:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5825:x1875400368067840:12345-0@lo:104: 00010000:00010000:0.0:1788521249.523647:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523700:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521249.523706:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5825:x1875400368067840:12345-0@lo:104: Request processed in 69us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.523713:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788521249.523727:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521249.523731:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523737:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166fa00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521249.523741:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523748:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521249.523755:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.523760:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521249.523809:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523817:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521249.523826:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523834:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016046 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01604d expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523857:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.523859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.523861:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521249.523871:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368068224:0@lo:103: 00000100:00100000:0.0:1788521249.523895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.523923:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068224 00000100:00100000:0.0:1788521249.523926:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068224 00010000:00010000:0.0:1788521249.523939:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.523958:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521249.523964:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3301:x1875400368068224:12345-0@lo:103: 00010000:00010000:0.0:1788521249.523971:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521249.523975:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523984:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.523994:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521249.523997:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a1200/0x53df1cebae01604d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016046 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.524006:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368067840:0@lo:104: 00000100:00100000:0.0:1788521249.524018:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:3301:x1875400368068224:12345-0@lo:103: Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.524024:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788521249.524033:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.524048:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368068224:0@lo:103: 00010000:00010000:3.0:1788521249.524351:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521249.524363:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368067968:0@lo:103: 00000100:00100000:3.0:1788521249.524394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521249.524438:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368067968 00000100:00100000:3.0:1788521249.524442:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368067968 00010000:00010000:3.0:1788521249.524459:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 11 pid: 5825 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521249.524489:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521249.524495:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:3303:x1875400368067968:12345-0@lo:103: 00010000:00010000:3.0:1788521249.524511:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521249.524515:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 11 pid: 5825 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524525:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 11 pid: 5825 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524536:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166f800/0x53df1cebae0160d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0160d2 expref: 11 pid: 5825 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524547:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524555:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524569:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524576:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524583:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524590:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524596:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166ec00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521249.524601:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524632:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524652:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.524662:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521249.524689:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:3303:x1875400368067968:12345-0@lo:103: Request processed in 194us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.524696:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521249.524720:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368067968:0@lo:103: 00010000:00010000:2.0:1788521249.524811:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.524820:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.524826:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016134 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788521249.524839:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788521249.615163:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:6688:x1875400368067456:12345-0@lo:253: Request processed in 111461us (112185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.615177:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521249.615390:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368067456:0@lo:253: 10000000:01000000:1.0:1788521249.615406:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788521249.615409:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521249.615411:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788521249.615413:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521249.615414:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788521249.615415:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521249.615417:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521249.615418:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521249.615420:0:6688:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788521249.615422:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521249.615424:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788521249.615452:0:6688:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0a75d22000 from lustre-OST0000 10000000:01000000:1.0:1788521249.615490:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788521249.615493:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788521249.615499:0:6688:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c0a489a19c0 local copy 10000000:01000000:1.0:1788521249.615503:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788521249.615535:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.615545:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.615554:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.615572:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068352:0@lo:101: 00000100:00100000:1.0:1788521249.615617:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521249.615669:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.615802:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068352 00000100:00100000:2.0:1788521249.615809:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068352 00000100:00100000:2.0:1788521249.615854:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788521249.615863:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:6688:x1875400368068352:12345-0@lo:101: 00010000:00010000:2.0:1788521249.615876:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521249.615899:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a82044c00/0x53df1cebae016142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01613b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.615923:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a82044c00/0x53df1cebae016142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01613b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.615932:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a82044c00/0x53df1cebae016142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01613b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.615941:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82044c00, rc 0) 00000100:00100000:2.0:1788521249.615981:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:6688:x1875400368068352:12345-0@lo:101: Request processed in 119us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521249.615987:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521249.617623:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068352:0@lo:101: 00010000:00010000:1.0:1788521249.617649:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.617662:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.617845:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068480:0@lo:501: 00000100:00100000:1.0:1788521249.617897:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521249.617936:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521249.618026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068480 00000100:00100000:3.0:1788521249.618032:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068480 00000100:00100000:3.0:1788521249.618076:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521249.618084:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:6688:x1875400368068480:12345-0@lo:501: 00000100:00100000:3.0:1788521249.618309:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:6688:x1875400368068480:12345-0@lo:501: Request processed in 225us (410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521249.618317:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521249.619463:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068480:0@lo:501: 10000000:01000000:1.0:1788521249.619497:0:6688:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788521249.619544:0:6688:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788521249.619552:0:6688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.619562:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.619568:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.619593:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521249.619794:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:1.0:1788521249.619797:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0a75d22000 10000000:01000000:1.0:1788521249.619802:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788521249.619802:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521249.619808:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c0a489a19c0 10000000:01000000:1.0:1788521249.619810:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788521249.619814:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c0a489a19c0 from 1 10000000:01000000:1.0:1788521249.619821:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788521249.619825:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166ea00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521249.619828:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.619836:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521249.619842:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.619847:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788521249.619852:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.619859:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.619865:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.619867:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.619871:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788521249.619883:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068608:0@lo:101: 00010000:00010000:0.0:1788521249.619911:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.619918:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a4166ea00/0x53df1cebae01613b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x53df1cebae016142 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.619928:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521249.619933:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.619935:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.619936:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521249.619966:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.620715:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521249.620730:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368068736:0@lo:103: 00000100:00100000:2.0:1788521249.620812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.620930:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068736 00000100:00100000:0.0:1788521249.620938:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068736 00000100:00100000:0.0:1788521249.620994:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521249.621003:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:3303:x1875400368068736:12345-0@lo:103: 00010000:00010000:0.0:1788521249.621016:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521249.621037:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82044c00/0x53df1cebae016142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae01613b expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.621056:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521249.621103:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:3303:x1875400368068736:12345-0@lo:103: Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.621111:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521249.621340:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068608 00000100:00100000:3.0:1788521249.621345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068608 00000100:00100000:3.0:1788521249.621379:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521249.621387:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+9:6688:x1875400368068608:12345-0@lo:101: 00010000:00010000:3.0:1788521249.621398:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521249.621411:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae016150 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016149 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.621438:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae016150 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016149 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.621450:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae016150 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016149 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.621457:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1c00, rc 0) 00000100:00100000:3.0:1788521249.621497:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:6688:x1875400368068608:12345-0@lo:101: Request processed in 110us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.621502:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788521249.621586:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368068736:0@lo:103: 00000100:00100000:0.0:1788521249.621808:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068608:0@lo:101: 00010000:00010000:0.0:1788521249.621824:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.621833:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.621851:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788521249.624053:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.624072:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.624081:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788521249.624095:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521249.624103:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788521249.624106:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521249.624154:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.624162:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.624200:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.624226:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068864:0@lo:101: 00000100:00100000:0.0:1788521249.624301:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.624349:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521249.624375:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068864 00000100:00100000:1.0:1788521249.624384:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068864 00000100:00100000:1.0:1788521249.624452:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788521249.624461:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+10:6688:x1875400368068864:12345-0@lo:101: 00010000:00010000:1.0:1788521249.624474:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521249.624493:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016157 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.624521:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016157 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.624530:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016157 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.624538:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166ec00, rc 0) 00000100:00100000:1.0:1788521249.624582:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368068864:12345-0@lo:101: Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521249.624595:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521249.626714:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068864:0@lo:101: 00010000:00010000:0.0:1788521249.626741:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.626753:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.626926:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068992:0@lo:501: 00000100:00100000:0.0:1788521249.626979:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.627024:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521249.627091:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368068992 00000100:00100000:3.0:1788521249.627097:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368068992 00000100:00100000:3.0:1788521249.627136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521249.627144:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368068992:12345-0@lo:501: 00000100:00100000:3.0:1788521249.627410:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368068992:12345-0@lo:501: Request processed in 265us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.627416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521249.627616:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368068992:0@lo:501: 00000100:00100000:0.0:1788521249.627654:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069120:0@lo:503: 00000100:00100000:0.0:1788521249.627693:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.627714:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521249.627762:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069120 00000100:00100000:3.0:1788521249.627797:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069120 00000100:00100000:3.0:1788521249.627822:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788521249.627828:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069120:12345-0@lo:503: 00000100:00100000:3.0:1788521249.627962:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069120:12345-0@lo:503: Request processed in 133us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.627968:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521249.628073:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069120:0@lo:503: 00000040:00080000:0.0:1788521249.628411:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521249.628600:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069248:0@lo:502: 00000100:00100000:0.0:1788521249.628642:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.628673:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.628696:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069248 00000100:00100000:0.0:1788521249.628700:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069248 00000100:00100000:0.0:1788521249.628723:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521249.628729:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069248:12345-0@lo:502: 00000100:00100000:0.0:1788521249.628912:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069248:12345-0@lo:502: Request processed in 182us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.628920:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788521249.628989:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069248:0@lo:502: 00000040:00080000:2.0:1788521249.629249:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788521249.629301:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788521249.629338:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788521249.629388:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788521249.629426:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788521249.629462:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788521249.629490:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069376:0@lo:502: 00000100:00100000:2.0:1788521249.629530:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521249.629568:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.630221:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069376 00000100:00100000:0.0:1788521249.630229:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069376 00000100:00100000:0.0:1788521249.630284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521249.630292:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069376:12345-0@lo:502: 00000100:00100000:0.0:1788521249.630674:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069376:12345-0@lo:502: Request processed in 382us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.630683:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788521249.631011:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069376:0@lo:502: 00000040:00080000:2.0:1788521249.631132:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788521249.631143:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788521249.636830:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521249.636842:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788521249.636850:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521249.636865:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788521249.636871:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521249.636952:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c0a7b9f3380) 00000020:00000080:3.0:1788521249.636977:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788521249.636984:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521249.637072:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a75d22000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788521249.637080:0:6706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521249.637087:0:6706:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x53df1cebae01616c 00010000:00010000:2.0:1788521249.645184:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788521249.645477:0:6706:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788521249.656250:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788521249.657054:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788521249.675665:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788521249.687656:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788521249.691263:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788521249.691274:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521249.691281:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521249.691283:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788521249.691286:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521249.691290:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521249.691291:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521249.691294:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521249.691296:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788521249.691359:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521249.691364:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521249.691366:0:6706:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788521249.691369:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788521249.692010:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788521249.692036:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788521249.692058:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.692070:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.692079:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a75d22000 from 1 10000000:01000000:0.0:1788521249.692082:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521249.692118:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.692126:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.692153:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.692180:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069504:0@lo:101: 00000100:00100000:0.0:1788521249.692240:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.692288:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf240 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.692623:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069504 00000100:00100000:0.0:1788521249.692631:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069504 00000100:00100000:0.0:1788521249.692676:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521249.692685:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:6688:x1875400368069504:12345-0@lo:101: 00010000:00010000:0.0:1788521249.692698:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521249.692710:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016173 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.692733:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016173 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.692745:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016173 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.692753:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030600, rc 0) 00000100:00100000:0.0:1788521249.693088:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069504:12345-0@lo:101: Request processed in 402us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.693096:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788521249.704099:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069504:0@lo:101: 00010000:00010000:2.0:1788521249.704129:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.704141:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521249.704801:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069632:0@lo:501: 00000100:00100000:3.0:1788521249.704864:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521249.704921:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.705599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069632 00000100:00100000:0.0:1788521249.705607:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069632 00000100:00100000:0.0:1788521249.705667:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521249.705676:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069632:12345-0@lo:501: 00000100:00100000:0.0:1788521249.705979:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069632:12345-0@lo:501: Request processed in 303us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.705987:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521249.706198:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069632:0@lo:501: 00000100:00100000:2.0:1788521249.706246:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069760:0@lo:503: 00000100:00100000:2.0:1788521249.706287:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521249.706317:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a465db540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521249.706793:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069760 00000100:00100000:3.0:1788521249.706799:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069760 00000100:00100000:3.0:1788521249.706829:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788521249.706836:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069760:12345-0@lo:503: 00000100:00100000:3.0:1788521249.707162:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069760:12345-0@lo:503: Request processed in 324us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.707170:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521249.707318:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069760:0@lo:503: 00000040:00080000:2.0:1788521249.707601:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521249.707686:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069888:0@lo:502: 00000100:00100000:2.0:1788521249.707727:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521249.707761:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a465db540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.708180:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368069888 00000100:00100000:0.0:1788521249.708186:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368069888 00000100:00100000:0.0:1788521249.708220:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521249.708229:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069888:12345-0@lo:502: 00000100:00100000:0.0:1788521249.708430:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368069888:12345-0@lo:502: Request processed in 202us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.708438:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521249.708838:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368069888:0@lo:502: 00000040:00080000:2.0:1788521249.709115:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788521249.709167:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788521249.709196:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070016:0@lo:502: 00000100:00100000:2.0:1788521249.709238:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521249.709277:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a465db540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.709465:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070016 00000100:00100000:0.0:1788521249.709471:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070016 00000100:00100000:0.0:1788521249.709506:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521249.709513:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368070016:12345-0@lo:502: 00000100:00100000:0.0:1788521249.709682:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368070016:12345-0@lo:502: Request processed in 168us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.709689:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788521249.709899:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070016:0@lo:502: 00000040:00080000:3.0:1788521249.709997:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788521249.710009:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788521249.719466:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521249.719482:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521249.719484:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788521249.719491:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a75d22000 00000020:00000080:3.0:1788521249.719494:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521249.719515:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521249.719518:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521249.719519:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788521249.719522:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788521249.719810:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788521249.719834:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521249.719858:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.719870:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.720064:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788521249.720069:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0a75d22000 10000000:01000000:0.0:1788521249.720072:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0a75d22000 10000000:01000000:0.0:1788521249.720087:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521249.720093:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a75d22000 from 1 10000000:01000000:0.0:1788521249.720095:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521249.720127:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.720135:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.720146:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.720166:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070144:0@lo:101: 00000100:00100000:0.0:1788521249.720227:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.720272:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521249.720322:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070144 00000100:00100000:3.0:1788521249.720329:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070144 00000100:00100000:3.0:1788521249.720373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521249.720382:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368070144:12345-0@lo:101: 00010000:00010000:3.0:1788521249.720394:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521249.720405:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016181 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.720428:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016181 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.720439:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016181 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521249.720447:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521249.720488:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070144:12345-0@lo:101: Request processed in 107us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.720494:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521249.720589:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070144:0@lo:101: 00010000:00010000:1.0:1788521249.720604:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521249.720613:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521249.720703:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070272:0@lo:501: 00000100:00100000:1.0:1788521249.720728:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521249.720740:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f63db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.720820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070272 00000100:00100000:2.0:1788521249.720824:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070272 00000100:00100000:2.0:1788521249.720851:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788521249.720858:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070272:12345-0@lo:501: 00000100:00100000:2.0:1788521249.721078:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070272:12345-0@lo:501: Request processed in 220us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521249.721086:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788521249.721295:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070272:0@lo:501: 00000100:00100000:1.0:1788521249.721322:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070400:0@lo:503: 00000100:00100000:1.0:1788521249.721358:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521249.721384:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f63db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.721422:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070400 00000100:00100000:2.0:1788521249.721426:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070400 00000100:00100000:2.0:1788521249.721454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521249.721461:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070400:12345-0@lo:503: 00000100:00100000:2.0:1788521249.721605:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070400:12345-0@lo:503: Request processed in 144us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521249.721618:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521249.721691:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070400:0@lo:503: 00000040:00080000:3.0:1788521249.722223:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521249.722359:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070528:0@lo:502: 00000100:00100000:3.0:1788521249.722402:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521249.722426:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.722491:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070528 00000100:00100000:2.0:1788521249.722497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070528 00000100:00100000:2.0:1788521249.722520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521249.722526:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070528:12345-0@lo:502: 00000100:00100000:2.0:1788521249.722841:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070528:12345-0@lo:502: Request processed in 313us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521249.722848:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521249.723575:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070528:0@lo:502: 00000040:00080000:3.0:1788521249.724106:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788521249.724164:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788521249.724198:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788521249.724242:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788521249.724344:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788521249.724399:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788521249.724436:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788521249.724470:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788521249.724538:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788521249.724576:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788521249.724608:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788521249.724731:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788521249.724880:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788521249.724988:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788521249.725033:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788521249.725080:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788521249.725109:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788521249.725150:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788521249.725182:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788521249.725212:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788521249.725254:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788521249.725445:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788521249.725485:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788521249.725532:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788521249.725566:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788521249.725691:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788521249.725762:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788521249.726008:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788521249.726055:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070656:0@lo:502: 00000100:00100000:3.0:1788521249.726128:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521249.726214:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521249.733755:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070656 00000100:00100000:2.0:1788521249.733868:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070656 00000100:00100000:2.0:1788521249.734146:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521249.734158:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070656:12345-0@lo:502: 00000100:00100000:2.0:1788521249.734464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368070656:12345-0@lo:502: Request processed in 308us (8335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521249.734472:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788521249.734562:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368070656:0@lo:502: 00000040:00080000:1.0:1788521249.734684:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788521249.734698:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788521249.739330:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788521249.739345:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c0a489a0000) 00000020:00000080:1.0:1788521249.739365:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788521249.739430:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a75d22000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521249.739434:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a75d22000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521249.739436:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a75d22000 3 00010000:00080000:1.0:1788521249.739462:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a7f66f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1788521249.741104:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788521249.746945:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788521249.746985:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521249.746997:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x53df1cebae016196 00000100:00080000:1.0:1788521249.747008:0:6711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521249.747015:0:6711:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0a7f66f000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1788521249.747049:0:6711:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a75410380 x1875400368070784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521249.747122:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875400368070784:0@lo:38: 00000100:00100000:2.0:1788521249.747189:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521249.747287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070784 00000100:00100000:3.0:1788521249.747295:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070784 00000100:00100000:3.0:1788521249.747324:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521249.747331:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875400368070784:12345-0@lo:38: 00010000:00080000:3.0:1788521249.747352:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1788521249.747380:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x53df1cebae01619d 00000004:00100000:3.0:1788521249.747394:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788521249.747423:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f3b4800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788521249.747478:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788521249.747536:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368070912:0@lo:400: 00000100:00100000:1.0:1788521249.747561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521249.747597:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788521249.747604:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:1.0:1788521249.748610:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788521249.751257:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788521249.752003:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521249.752023:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.752035:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788521249.752606:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788521249.752609:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788521249.752610:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521249.752611:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521249.754567:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521249.754574:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521249.754576:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521249.754577:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521249.754579:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521249.754580:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521249.754597:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521249.754602:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788521249.754605:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521249.754615:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788521249.754617:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521249.754618:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521249.754620:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521249.754621:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521249.754622:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521249.754624:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521249.754625:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521249.754626:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521249.754627:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788521249.754657:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788521249.754675:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368071040:0@lo:253: 00000100:00100000:0.0:1788521249.754740:0:6688:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521249.754803:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521249.755068:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071040 00000100:00100000:1.0:1788521249.755077:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071040 00000100:00100000:1.0:1788521249.755124:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788521249.755134:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6688:x1875400368071040:12345-0@lo:253: 20000000:01000000:1.0:1788521249.755160:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788521249.755175:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788521249.757149:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521249.757166:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368070912 00000100:00100000:0.0:1788521249.757174:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368070912 00000100:00100000:0.0:1788521249.757208:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788521249.757217:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521249.757226:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368070912:12345-0@lo:400: 00000100:00100000:0.0:1788521249.757326:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368070912:12345-0@lo:400: Request processed in 101us (9763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.757333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788521249.757533:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0a75413800 x1875400368070912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521249.757549:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75413800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368070912:0@lo:400: 00000100:00100000:3.0:1788521249.763111:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875400368070784:12345-0@lo:38: Request processed in 15768us (15911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521249.763126:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788521249.763223:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0a75410380 x1875400368070784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521249.763235:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521249.763246:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788521249.763254:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788521249.763258:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788521249.763262:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f66f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788521249.763268:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875400368070784:0@lo:38: 00010000:00010000:1.0:1788521249.770255:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1788521249.801458:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521249.801476:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788521249.801727:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788521249.801733:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788521249.801753:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.801808:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0160fc expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.801850:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.801927:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0160fc expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.801952:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0160fc expref: 13 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521249.801966:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875400368071168:0@lo:104: 00000100:00100000:2.0:1788521249.802053:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521249.802136:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4562f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521249.803520:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071168 00000100:00100000:0.0:1788521249.803532:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071168 00000100:00100000:0.0:1788521249.803720:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521249.803733:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5848:x1875400368071168:12345-0@lo:104: 00010000:00010000:0.0:1788521249.803845:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804008:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788521249.804014:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5848:x1875400368071168:12345-0@lo:104: Request processed in 285us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.804022:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788521249.804042:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521249.804048:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804056:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031c00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521249.804060:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804069:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521249.804076:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521249.804082:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521249.804115:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804122:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521249.804138:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804145:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40031c00/0x53df1cebae0160fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016103 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804172:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.804174:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521249.804176:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521249.804198:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368071296:0@lo:103: 00000100:00100000:0.0:1788521249.804235:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521249.804391:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875400368071168:0@lo:104: 00010000:00010000:3.0:1788521249.804479:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.804528:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071296 00000100:00100000:0.0:1788521249.804534:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071296 00010000:00010000:0.0:1788521249.804552:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160fc expref: 14 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.804583:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521249.804589:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3300:x1875400368071296:12345-0@lo:103: 00010000:00010000:0.0:1788521249.804599:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521249.804604:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0160fc expref: 14 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804734:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0160fc expref: 14 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.804750:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166e200/0x53df1cebae016103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0160fc expref: 14 pid: 5828 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805111:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805121:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521249.805345:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003612442s 00010000:00010000:0.0:1788521249.805359:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805367:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805376:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805383:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805389:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82045600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521249.805394:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805403:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805956:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521249.805968:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521249.806071:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46425050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3300:x1875400368071296:12345-0@lo:103: Request processed in 1480us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.806079:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521249.806170:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368071296:0@lo:103: 00010000:00010000:2.0:1788521249.806610:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.806627:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521249.806634:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82045600/0x53df1cebae0161a4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521249.822236:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:6688:x1875400368071040:12345-0@lo:253: Request processed in 67004us (67395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521249.822254:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521249.822441:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:6688:1875400368071040:0@lo:253: 10000000:01000000:2.0:1788521249.822456:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788521249.822460:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521249.822461:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521249.822463:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521249.822464:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521249.822465:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521249.822466:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521249.822468:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521249.822494:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521249.822495:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521249.822497:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521249.822498:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521249.822523:0:6688:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788521249.827875:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521249.828196:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788521249.828578:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521249.828960:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788521249.829186:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788521249.830098:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788521249.831832:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788521250.080569:0:6688:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788521250.080583:0:6688:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788521250.080629:0:6688:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788521250.080695:0:6688:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788521250.080709:0:6688:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788521250.080736:0:6688:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788521250.795450:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521251.048956:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788521251.048964:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a4f90d800 from 21 10000000:01000000:0.0:1788521251.048969:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521251.049129:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.049141:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.049152:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521251.049177:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368071424:0@lo:101: 00000100:00100000:0.0:1788521251.049236:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.049290:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521251.049491:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071424 00000100:00100000:1.0:1788521251.049499:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071424 00000100:00100000:1.0:1788521251.049552:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788521251.049561:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368071424:12345-0@lo:101: 00010000:00010000:1.0:1788521251.049574:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521251.049597:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0161ab expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521251.049618:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0161ab expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521251.049628:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161ab expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521251.049637:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166f400, rc 0) 00000100:00100000:1.0:1788521251.049724:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368071424:12345-0@lo:101: Request processed in 163us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521251.049731:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521251.050150:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368071424:0@lo:101: 00010000:00010000:3.0:1788521251.050165:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521251.050174:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521251.050249:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368071552:0@lo:501: 00000100:00100000:3.0:1788521251.050277:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521251.050337:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.050366:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071552 00000100:00100000:0.0:1788521251.050371:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071552 00000100:00100000:0.0:1788521251.050428:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521251.050435:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368071552:12345-0@lo:501: 00000100:00100000:0.0:1788521251.050835:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368071552:12345-0@lo:501: Request processed in 390us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.050843:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521251.053401:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368071552:0@lo:501: 00000100:00100000:3.0:1788521251.053451:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368071680:0@lo:503: 00000100:00100000:3.0:1788521251.053514:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521251.053771:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f050c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521251.053863:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071680 00000100:00100000:1.0:1788521251.053870:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071680 00000100:00100000:1.0:1788521251.053912:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788521251.053921:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368071680:12345-0@lo:503: 00000100:00100000:1.0:1788521251.054506:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368071680:12345-0@lo:503: Request processed in 583us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521251.054514:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521251.054717:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368071680:0@lo:503: 00000100:00100000:0.0:1788521251.055474:0:6754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6754:1875400368071808:0@lo:502: 00000100:00100000:0.0:1788521251.055525:0:6754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.055652:0:6754:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b170c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521251.055702:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071808 00000100:00100000:1.0:1788521251.055712:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071808 00000100:00100000:1.0:1788521251.057747:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521251.057787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6754:x1875400368071808:12345-0@lo:502: 00000100:00100000:1.0:1788521251.058685:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6754:x1875400368071808:12345-0@lo:502: Request processed in 925us (3157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521251.058695:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521251.060333:0:6754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6754:1875400368071808:0@lo:502: 00000100:00100000:3.0:1788521251.060421:0:6754:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6754:1875400368071936:0@lo:502: 00000100:00100000:3.0:1788521251.060477:0:6754:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521251.060517:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368071936 00000100:00100000:3.0:1788521251.060522:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368071936 00000100:00100000:3.0:1788521251.060558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521251.060564:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6754:x1875400368071936:12345-0@lo:502: 00000100:00100000:2.0:1788521251.060748:0:6754:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f050c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521251.065389:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:6754:x1875400368071936:12345-0@lo:502: Request processed in 4816us (4903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521251.065403:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521251.065476:0:6754:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6754:1875400368071936:0@lo:502: 00000040:00080000:2.0:1788521251.065510:0:6754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788521251.065977:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788521251.067202:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521251.067217:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521251.067229:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521251.067256:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788521251.067258:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c0a4f90d800 from 4 10000000:01000000:3.0:1788521251.067261:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788521251.067299:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521251.067306:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521251.067315:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521251.067336:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072064:0@lo:101: 00000100:00100000:3.0:1788521251.067394:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521251.067441:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f05600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.067507:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072064 00000100:00100000:0.0:1788521251.067515:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072064 00000100:00100000:0.0:1788521251.067563:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788521251.067572:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368072064:12345-0@lo:101: 00010000:00010000:0.0:1788521251.067593:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521251.067606:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0161b9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.067628:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.067638:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.067647:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030a00, rc 0) 00000100:00100000:0.0:1788521251.067688:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368072064:12345-0@lo:101: Request processed in 116us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.067694:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521251.067974:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072064:0@lo:101: 00010000:00010000:3.0:1788521251.068000:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521251.068017:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521251.068070:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072192:0@lo:256: 00000100:00100000:3.0:1788521251.068102:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521251.068272:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f05600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.069170:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072192 00000100:00100000:0.0:1788521251.069178:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072192 00000100:00100000:0.0:1788521251.069273:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788521251.069282:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368072192:12345-0@lo:256: 20000000:01000000:0.0:1788521251.069301:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788521251.069317:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788521251.069320:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788521251.069423:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368072192:12345-0@lo:256: Request processed in 142us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.069430:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521251.069494:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072192:0@lo:256: 10000000:01000000:2.0:1788521251.069550:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788521251.069558:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521251.069567:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521251.069575:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788521251.069577:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788521251.069579:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788521251.069603:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521251.069611:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521251.069625:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521251.069641:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072320:0@lo:101: 00000100:00100000:2.0:1788521251.069668:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.069701:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.070721:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072320 00000100:00100000:0.0:1788521251.070735:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072320 00000100:00100000:0.0:1788521251.070802:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788521251.070811:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368072320:12345-0@lo:101: 00010000:00010000:0.0:1788521251.070821:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521251.070835:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0161c7 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.070858:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.070867:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.070876:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030c00, rc 0) 00000100:00100000:0.0:1788521251.070922:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368072320:12345-0@lo:101: Request processed in 112us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.070928:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788521251.071018:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072320:0@lo:101: 00010000:00010000:2.0:1788521251.071032:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521251.071041:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521251.071093:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072448:0@lo:501: 00000100:00100000:2.0:1788521251.071121:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.071152:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.071189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072448 00000100:00100000:0.0:1788521251.071194:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072448 00000100:00100000:0.0:1788521251.071212:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521251.071219:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368072448:12345-0@lo:501: 00000100:00100000:0.0:1788521251.071505:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368072448:12345-0@lo:501: Request processed in 285us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.071511:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788521251.071566:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072448:0@lo:501: 00000100:00100000:2.0:1788521251.071590:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072576:0@lo:503: 00000100:00100000:2.0:1788521251.071625:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.071646:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.071683:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072576 00000100:00100000:0.0:1788521251.071688:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072576 00000100:00100000:0.0:1788521251.071718:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788521251.071724:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368072576:12345-0@lo:503: 00000100:00100000:0.0:1788521251.072021:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368072576:12345-0@lo:503: Request processed in 296us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.072033:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788521251.072068:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368072576:0@lo:503: 00000100:00100000:0.0:1788521251.072231:0:6756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6756:1875400368072704:0@lo:502: 00000100:00100000:0.0:1788521251.072262:0:6756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.072281:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072704 00000100:00100000:0.0:1788521251.072284:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072704 00000100:00100000:0.0:1788521251.072302:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521251.072308:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:6756:x1875400368072704:12345-0@lo:502: 00000100:00100000:0.0:1788521251.072800:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:6756:x1875400368072704:12345-0@lo:502: Request processed in 491us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.072806:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521251.072839:0:6756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9dad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.072852:0:6756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6756:1875400368072704:0@lo:502: 00000020:01000000:0.0:1788521251.072886:0:6756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521251.072893:0:6756:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788521251.072900:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521251.072902:0:6756:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788521251.072906:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788521251.072910:0:6756:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:0.0:1788521251.072930:0:6756:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788521251.072932:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521251.072944:0:6756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0a458ecd40) 00000020:00000080:0.0:1788521251.072961:0:6756:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788521251.072966:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788521251.073033:0:6756:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788521251.073038:0:6756:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788521251.073044:0:6756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0161dc 00010000:00080000:0.0:1788521251.073080:0:6756:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a7c4a8000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1788521251.073302:0:6756:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788521251.138818:0:6756:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788521251.138841:0:6756:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788521251.140727:0:6756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521251.141015:0:6756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521251.141059:0:6756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788521251.141110:0:6756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788521251.143683:0:6764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521251.143691:0:6764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788521251.149375:0:6756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788521251.153291:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788521251.153356:0:6756:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788521251.153380:0:6756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0161e3 00000100:00080000:0.0:1788521251.153393:0:6756:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521251.153398:0:6756:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c0a7c4a8000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521251.153431:0:6756:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a458e2d80 x1875400368072832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521251.153494:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368072832:0@lo:8: 00000100:00100000:2.0:1788521251.153560:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788521251.154229:0:6756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788521251.154314:0:6756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521251.154320:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521251.154322:0:6756:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788521251.154325:0:6756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521251.154329:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521251.154330:0:6756:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521251.154332:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521251.154334:0:6756:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788521251.154361:0:6756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6756:1875400368072960:0@lo:502: 00000100:00100000:0.0:1788521251.154408:0:6756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.154428:0:6756:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521251.154673:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072960 00000100:00100000:3.0:1788521251.154680:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072960 00000100:00100000:3.0:1788521251.154722:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521251.154732:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:6756:x1875400368072960:12345-0@lo:502: 00000100:00100000:3.0:1788521251.154993:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:6756:x1875400368072960:12345-0@lo:502: Request processed in 261us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521251.155000:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521251.155043:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368072832 00000100:00100000:3.0:1788521251.155047:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368072832 00000100:00100000:3.0:1788521251.155066:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521251.155071:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875400368072832:12345-0@lo:8: 00010000:00080000:3.0:1788521251.155092:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1788521251.155116:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0161ea 00002000:00100000:3.0:1788521251.155153:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c0a7f3b0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788521251.155158:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1788521251.155162:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788521251.155266:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788521251.155417:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521251.155439:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f3b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521251.155958:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368073088:0@lo:400: 00000100:00100000:0.0:1788521251.156004:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.156059:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368073216:0@lo:400: 00000100:00100000:0.0:1788521251.156084:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.156127:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073088 00000100:00100000:0.0:1788521251.156132:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073088 00000100:00100000:0.0:1788521251.156161:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073216 00000100:00100000:0.0:1788521251.156164:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073216 00000100:00100000:0.0:1788521251.156201:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521251.156208:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368073088:12345-0@lo:400: 00000100:00100000:0.0:1788521251.156247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368073088:12345-0@lo:400: Request processed in 39us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.156253:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521251.156268:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521251.156275:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368073216:12345-0@lo:400: 00000100:00100000:0.0:1788521251.156304:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368073216:12345-0@lo:400: Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.156310:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788521251.156329:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521251.156356:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75410380 x1875400368073088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521251.156369:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368073088:0@lo:400: 00010000:00080000:0.0:1788521251.156393:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75411880 x1875400368073216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521251.156400:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368073216:0@lo:400: 00000100:00100000:0.0:1788521251.156420:0:6756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:6756:1875400368072960:0@lo:502: 00000020:01000000:0.0:1788521251.156458:0:6756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521251.156465:0:6756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521251.156467:0:6756:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521251.156471:0:6756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788521251.156586:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788521251.156604:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788521251.156613:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156635:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521251.156644:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788521251.156647:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0a489a19c0 from 1 10000000:01000000:0.0:1788521251.156649:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788521251.156675:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156683:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156693:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521251.156708:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368073344:0@lo:101: 00000100:00100000:0.0:1788521251.156739:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.156765:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521251.156798:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073344 00000100:00100000:0.0:1788521251.156802:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073344 00000100:00100000:0.0:1788521251.156826:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521251.156832:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368073344:12345-0@lo:101: 00010000:00010000:0.0:1788521251.156840:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521251.156852:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0161f1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156873:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156897:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156907:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031c00, rc 0) 00000100:00100000:0.0:1788521251.156936:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368073344:12345-0@lo:101: Request processed in 104us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521251.156942:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521251.156979:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368073344:0@lo:101: 00010000:00010000:0.0:1788521251.156990:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.156998:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521251.158433:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368073472:0@lo:501: 00000100:00100000:0.0:1788521251.158483:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.158541:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521251.158636:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073472 00000100:00100000:1.0:1788521251.158641:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073472 00000100:00100000:1.0:1788521251.158680:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788521251.158687:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368073472:12345-0@lo:501: 00000100:00100000:1.0:1788521251.158937:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368073472:12345-0@lo:501: Request processed in 250us (452us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521251.158945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521251.159049:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368073472:0@lo:501: 10000000:01000000:0.0:1788521251.159076:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788521251.159083:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521251.159092:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521251.164040:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875400368072832:12345-0@lo:8: Request processed in 8958us (10470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521251.164053:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788521251.166143:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e2d80 x1875400368072832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521251.166159:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521251.166169:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788521251.166177:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788521251.166183:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788521251.166186:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7c4a8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788521251.166216:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788521251.166222:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368072832:0@lo:8: 00000004:00080000:3.0:1788521251.166331:0:6764:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788521251.166466:0:6764:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 172244691478ns, next at 0ns, rc = 0 00000004:00080000:1.0:1788521251.245451:0:6766:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788521251.245484:0:6766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368073728:0@lo:7: 00000100:00100000:1.0:1788521251.245555:0:6766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521251.245600:0:6766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521251.245613:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521251.245624:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368073600:0@lo:13: 00000100:00100000:1.0:1788521251.245649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521251.245702:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073728 00000100:00100000:1.0:1788521251.245711:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073728 00000100:00100000:1.0:1788521251.247353:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521251.247370:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6766:x1875400368073728:12345-0@lo:7: 00000004:00080000:0.0:1788521251.250394:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:2.0:1788521251.250887:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521251.250920:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073600 00000100:00100000:2.0:1788521251.250929:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073600 00000100:00100000:2.0:1788521251.250979:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521251.250989:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368073600:12345-0@lo:13: 00002000:00000024:2.0:1788521251.252380:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788521251.252465:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368073600:12345-0@lo:13: Request processed in 1476us (6812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521251.252474:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788521251.252599:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75412d80 x1875400368073600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521267 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521251.252621:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368073600:0@lo:13: 00002000:00080000:1.0:1788521251.257460:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788521251.257469:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788521251.257628:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6766:x1875400368073728:12345-0@lo:7: Request processed in 10260us (12068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521251.257647:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788521251.258675:0:6766:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75411180 x1875400368073728/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521267 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521251.258697:0:6766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368073728:0@lo:7: 00000004:00080000:0.0:1788521251.258714:0:6766:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788521251.258770:0:6766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368073856:0@lo:5: 00000100:00100000:0.0:1788521251.261125:0:6766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521251.261172:0:6766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521251.261449:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073856 00000100:00100000:2.0:1788521251.261456:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073856 00000100:00100000:2.0:1788521251.261505:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521251.261514:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6766:x1875400368073856:12345-0@lo:5: 00002000:00080000:2.0:1788521251.261542:0:6690:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788521251.261545:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788521251.262139:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6766:x1875400368073856:12345-0@lo:5: Request processed in 624us (1013us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788521251.262148:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788521251.262192:0:6766:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e1180 x1875400368073856/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521267 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521251.262220:0:6766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368073856:0@lo:5: 00000004:00080000:2.0:1788521251.262231:0:6766:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788521251.262265:0:6766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368073984:0@lo:700: 00000100:00100000:2.0:1788521251.262295:0:6766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.262310:0:6766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521251.262330:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368073984 00000100:00100000:2.0:1788521251.262333:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368073984 00000100:00100000:2.0:1788521251.262360:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521251.262368:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6766:x1875400368073984:12345-0@lo:700: 00000100:00100000:2.0:1788521251.262395:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1875400368074112:0@lo:700: 00000100:00100000:2.0:1788521251.262423:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.262440:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521251.262462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074112 00000100:00100000:2.0:1788521251.262466:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074112 00000100:00100000:2.0:1788521251.262507:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521251.262515:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1875400368074112:12345-0@lo:700: 40000000:02000000:2.0:1788521251.325374:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788521251.334285:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1875400368074112:12345-0@lo:700: Request processed in 71764us (71854us total) trans 0 rc 0/0 00010000:00080000:2.0:1788521251.334537:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75d15880 x1875400368074112/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521267 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521251.334554:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1875400368074112:0@lo:700: 40000000:02000000:2.0:1788521251.334568:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788521251.335107:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521251.478005:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6766:x1875400368073984:12345-0@lo:700: Request processed in 215627us (215699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521251.478021:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:2.0:1788521251.478074:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788521251.478085:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788521251.478123:0:6766:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75d17800 x1875400368073984/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521267 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521251.478139:0:6766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368073984:0@lo:700: 00000004:02000040:2.0:1788521251.511747:0:6766:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788521251.526044:0:6766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368074240:0@lo:5: 00000100:00100000:2.0:1788521251.526111:0:6766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521251.526158:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074240 00000100:00100000:2.0:1788521251.526164:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074240 00000100:00100000:2.0:1788521251.526210:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521251.526219:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6766:x1875400368074240:12345-0@lo:5: 00000100:00100000:3.0:1788521251.527897:0:6766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615840 going to sleep for 11 seconds 00002000:00080000:3.0:1788521251.547529:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788521251.547550:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788521251.565956:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6766:x1875400368074240:12345-0@lo:5: Request processed in 39731us (39838us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788521251.565973:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788521251.567841:0:6766:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75d17800 x1875400368074240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521267 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521251.567859:0:6766:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788521251.567888:0:6766:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8c0a75d17800 x1875400368074240/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521267 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521251.567909:0:6766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6766:1875400368074240:0@lo:5: 00000004:00080000:3.0:1788521251.567923:0:6766:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788521251.835419:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521252.845074:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521253.874760:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521254.893832:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521255.916849:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521256.553145:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368074368:0@lo:13: 00000100:00100000:0.0:1788521256.553212:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521256.553259:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368074496:0@lo:400: 00000100:00100000:1.0:1788521256.553294:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521256.553309:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074368 00000100:00100000:0.0:1788521256.553316:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074368 00000100:00100000:1.0:1788521256.553324:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368074752:0@lo:400: 00000100:00100000:1.0:1788521256.553349:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521256.553366:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521256.553367:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521256.553371:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368074624:0@lo:400: 00000100:00100000:0.0:1788521256.553375:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368074368:12345-0@lo:13: 00000100:00100000:1.0:1788521256.553389:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788521256.553409:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788521256.553418:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521256.553429:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074496 00000100:00100000:1.0:1788521256.553432:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074496 00000100:00100000:0.0:1788521256.553452:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368074368:12345-0@lo:13: Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521256.553456:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521256.553462:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3301:x1875400368074496:12345-0@lo:400: 00000100:00100000:0.0:1788521256.553468:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521256.553493:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3301:x1875400368074496:12345-0@lo:400: Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521256.553496:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074752 00000100:00100000:1.0:1788521256.553499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788521256.553499:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074752 00000100:00100000:0.0:1788521256.553526:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074624 00000100:00100000:0.0:1788521256.553529:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074624 00000100:00100000:0.0:1788521256.553546:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521256.553551:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368074752:12345-0@lo:400: 00000100:00100000:0.0:1788521256.553586:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368074752:12345-0@lo:400: Request processed in 34us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521256.553592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521256.553604:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521256.553609:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368074624:12345-0@lo:400: 00000100:00100000:0.0:1788521256.553632:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368074624:12345-0@lo:400: Request processed in 23us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521256.553637:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788521256.553662:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521256.553686:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75412d80 x1875400368074624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521256.553699:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75412d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368074624:0@lo:400: 00010000:00080000:0.0:1788521256.553709:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75411880 x1875400368074752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521256.553727:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368074752:0@lo:400: 00010000:00080000:0.0:1788521256.553754:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75d19180 x1875400368074368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521272 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521256.553768:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368074368:0@lo:13: 00000100:00100000:1.0:1788521256.559988:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368074496:0@lo:400: 00000001:00080000:3.0:1788521256.639972:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788521256.936935:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521257.304767:0:7060:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788521257.962529:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521258.984944:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521260.009498:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521261.033674:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521261.673032:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368074880:0@lo:13: 00000100:00100000:0.0:1788521261.673133:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521261.673333:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368074880 00000100:00100000:0.0:1788521261.673343:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368074880 00000100:00100000:0.0:1788521261.673405:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521261.673414:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368074880:12345-0@lo:13: 00002000:00000024:0.0:1788521261.673461:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521261.673526:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368074880:12345-0@lo:13: Request processed in 112us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521261.673534:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788521261.673558:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521261.673595:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75d1b480 x1875400368074880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521261.673607:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788521261.673633:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368074880:0@lo:13: 00000100:00100000:0.0:1788521261.674456:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368075264:0@lo:400: 00000100:00100000:0.0:1788521261.674521:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521261.674544:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368075008:0@lo:400: 00000100:00100000:0.0:1788521261.674556:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521261.674566:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368075136:0@lo:400: 00000100:00100000:0.0:1788521261.677597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521261.677701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075264 00000100:00100000:0.0:1788521261.677713:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075264 00000100:00100000:0.0:1788521261.677825:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075136 00000100:00100000:0.0:1788521261.677829:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075136 00000100:00100000:0.0:1788521261.677859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521261.677870:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368075264:12345-0@lo:400: 00000100:00100000:0.0:1788521261.677947:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368075264:12345-0@lo:400: Request processed in 80us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521261.677955:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521261.677978:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521261.677984:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368075136:12345-0@lo:400: 00000100:00100000:0.0:1788521261.678014:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368075136:12345-0@lo:400: Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521261.678019:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788521261.678045:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521261.678086:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e3480 x1875400368075136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521261.678102:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368075136:0@lo:400: 00010000:00080000:0.0:1788521261.678116:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e1880 x1875400368075264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521261.678125:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368075264:0@lo:400: 00000100:00100000:1.0:1788521261.680401:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521261.680498:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075008 00000100:00100000:1.0:1788521261.680507:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075008 00000100:00100000:1.0:1788521261.680561:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788521261.680571:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3301:x1875400368075008:12345-0@lo:400: 00000100:00100000:1.0:1788521261.680637:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3301:x1875400368075008:12345-0@lo:400: Request processed in 68us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521261.680659:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788521261.680757:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368075008:0@lo:400: 00010000:00010000:0.0:1788521262.057200:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521263.081130:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521264.113183:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521265.129983:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521266.162412:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521266.799869:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368075392:0@lo:13: 00000100:00100000:3.0:1788521266.799937:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521266.800011:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075392 00000100:00100000:3.0:1788521266.800018:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075392 00000100:00100000:3.0:1788521266.800069:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521266.800078:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368075392:12345-0@lo:13: 00002000:00000024:3.0:1788521266.800111:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521266.800154:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368075392:12345-0@lo:13: Request processed in 77us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521266.800160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788521266.800179:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521266.800208:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75d1bb80 x1875400368075392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521266.800225:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368075392:0@lo:13: 00000100:00100000:2.0:1788521266.808064:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521266.808750:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368075776:0@lo:400: 00000100:00100000:0.0:1788521266.808847:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521266.808882:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521266.808888:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368075648:0@lo:400: 00000100:00100000:0.0:1788521266.808920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521266.808951:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075776 00000100:00100000:0.0:1788521266.808958:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075776 00000100:00100000:0.0:1788521266.809014:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075648 00000100:00100000:0.0:1788521266.809018:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075648 00000100:00100000:0.0:1788521266.809041:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521266.809049:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368075776:12345-0@lo:400: 00000100:00100000:0.0:1788521266.809098:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368075776:12345-0@lo:400: Request processed in 50us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521266.809106:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521266.809124:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521266.809131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368075648:12345-0@lo:400: 00000100:00100000:0.0:1788521266.809156:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368075648:12345-0@lo:400: Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521266.809161:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788521266.809198:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e1880 x1875400368075648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521266.809210:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368075648:0@lo:400: 00010000:00080000:0.0:1788521266.809221:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e3480 x1875400368075776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521266.809228:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368075776:0@lo:400: 00000100:00080000:0.0:1788521266.809904:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521266.811383:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368075520:0@lo:400: 00000100:00100000:2.0:1788521266.811461:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521266.811570:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075520 00000100:00100000:0.0:1788521266.811578:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075520 00000100:00100000:0.0:1788521266.811626:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788521266.811635:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3300:x1875400368075520:12345-0@lo:400: 00000100:00100000:0.0:1788521266.811705:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3300:x1875400368075520:12345-0@lo:400: Request processed in 72us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521266.811712:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521266.813559:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368075520:0@lo:400: 00010000:00010000:1.0:1788521267.179332:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521268.207015:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521269.229464:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788521269.682375:0:7636:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788521269.682379:0:7636:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788521269.682510:0:7636:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c0a7f66c000 00000020:01000004:1.0:1788521269.682526:0:7636:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788521269.682539:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788521269.683725:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c0a489a3380) 00000020:00000080:1.0:1788521269.684720:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788521269.723126:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788521269.723412:0:7636:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788521269.781289:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788521269.796702:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788521269.796742:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788521269.796975:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788521269.797008:0:7636:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788521269.798281:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788521269.798293:0:7636:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788521269.798303:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x53df1cebae016206 00000020:01000004:3.0:1788521269.798310:0:7636:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788521269.798331:0:7636:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788521269.798335:0:7636:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788521269.798340:0:7636:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788521269.798362:0:7636:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788521269.798366:0:7636:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788521269.850290:0:7636:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788521269.850326:0:7636:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788521269.850330:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788521269.850331:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521269.850333:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521269.850334:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521269.850335:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521269.850337:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521269.850338:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521269.850340:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521269.850341:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521269.850342:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521269.850344:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521269.850347:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788521269.850350:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788521269.850351:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521269.850352:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521269.850353:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521269.850354:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521269.850355:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521269.850356:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521269.850357:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788521269.850358:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788521269.850359:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521269.850360:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788521269.850386:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788521269.850403:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368075904:0@lo:253: 00000100:00100000:0.0:1788521269.850474:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521269.850512:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521269.851195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368075904 00000100:00100000:1.0:1788521269.851203:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368075904 00000100:00100000:1.0:1788521269.851261:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521269.851271:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:7636:x1875400368075904:12345-0@lo:253: 20000000:01000000:1.0:1788521269.851302:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788521269.851307:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788521269.851312:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788521269.851315:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788521269.852373:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521269.852583:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788521269.852597:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788521269.852652:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788521269.852661:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788521269.852691:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788521269.852738:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788521269.853991:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788521269.854018:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:1.0:1788521269.854028:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:1.0:1788521269.854076:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788521269.854084:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788521269.854288:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788521269.854298:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:1.0:1788521269.854331:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788521269.854340:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788521269.854370:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788521269.854416:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788521269.857247:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788521269.857280:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:1.0:1788521269.857293:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:1.0:1788521269.857335:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788521269.857344:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788521269.857396:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788521269.857405:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:1.0:1788521269.857437:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788521269.857446:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788521269.857494:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788521269.857531:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788521269.857721:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788521269.857725:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788521269.857731:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788521269.857732:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788521269.857735:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788521269.857961:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788521269.857964:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788521269.858005:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788521269.858008:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788521269.864336:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788521269.864461:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788521269.864494:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788521269.867949:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788521269.868004:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788521269.868325:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788521269.868353:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788521269.868356:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788521269.871285:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788521269.871372:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788521269.871427:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788521269.872078:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788521269.872140:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788521269.872205:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788521269.872220:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788521269.872222:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788521269.873041:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788521269.873423:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788521269.873467:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788521269.873535:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788521269.873566:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788521269.873569:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788521269.875167:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788521269.875238:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788521269.875292:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788521269.875699:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788521269.875740:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788521269.875981:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1788521269.876000:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788521269.876019:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876037:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016157 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876046:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016181 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876054:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161ab expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876062:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876069:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876077:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876283:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876309:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 16 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.876323:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076032:0@lo:104: 00000100:00100000:1.0:1788521269.876388:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521269.876442:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876451:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 16 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.876459:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75413800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076160:0@lo:104: 00010000:00010000:1.0:1788521269.876483:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0161ab expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876490:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0161ab expref: 16 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.876498:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076288:0@lo:104: 00010000:00010000:1.0:1788521269.876516:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016181 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.876524:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016181 expref: 16 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.876531:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076416:0@lo:104: 00010000:00010000:1.0:1788521269.880080:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016157 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.880128:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016157 expref: 16 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.880143:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076544:0@lo:104: 00000100:00100000:1.0:1788521269.880202:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a46245b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521269.880508:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788521269.880539:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.880585:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.880594:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.880603:0:5816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.880614:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076032 00000100:00100000:2.0:1788521269.880621:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076032 00000100:00100000:2.0:1788521269.880667:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076160 00000100:00100000:2.0:1788521269.880670:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076160 00000100:00100000:2.0:1788521269.880681:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076288 00000100:00100000:2.0:1788521269.880684:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076288 00000100:00100000:2.0:1788521269.880694:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076416 00000100:00100000:2.0:1788521269.880696:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076416 00000100:00100000:2.0:1788521269.880703:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076544 00000100:00100000:2.0:1788521269.880705:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076544 00000100:00100000:2.0:1788521269.880717:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521269.880724:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+7:5825:x1875400368076032:12345-0@lo:104: 00010000:00010000:2.0:1788521269.880738:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.880824:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521269.880830:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46254850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+7:5825:x1875400368076032:12345-0@lo:104: Request processed in 106us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.880837:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521269.880872:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521269.880878:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:5825:x1875400368076160:12345-0@lo:104: 00010000:00010000:2.0:1788521269.880886:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.880917:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521269.880922:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:5825:x1875400368076160:12345-0@lo:104: Request processed in 45us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.880928:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521269.880951:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521269.880957:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:5825:x1875400368076288:12345-0@lo:104: 00010000:00010000:2.0:1788521269.880964:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.880993:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788521269.880998:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:5825:x1875400368076288:12345-0@lo:104: Request processed in 42us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.881004:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521269.881015:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521269.881021:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:5825:x1875400368076416:12345-0@lo:104: 00010000:00010000:2.0:1788521269.881028:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881054:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788521269.881058:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:5825:x1875400368076416:12345-0@lo:104: Request processed in 38us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.881063:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521269.881074:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521269.881080:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5825:x1875400368076544:12345-0@lo:104: 00010000:00010000:2.0:1788521269.881101:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881130:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788521269.881134:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5825:x1875400368076544:12345-0@lo:104: Request processed in 55us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.881140:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788521269.881157:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788521269.881167:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881174:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031000 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521269.881178:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881187:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521269.881194:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521269.881199:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521269.881230:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881236:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521269.881253:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881261:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40031000/0x53df1cebae0161f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161f8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881287:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788521269.881291:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881297:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82044200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521269.881300:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881316:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521269.881322:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521269.881328:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521269.881341:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881347:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521269.881352:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881358:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae0161c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161ce expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881370:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521269.881373:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881378:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521269.881380:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881387:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521269.881393:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521269.881405:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521269.881418:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881423:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521269.881437:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881444:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae0161ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161b2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881454:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521269.881457:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881462:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031600 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521269.881465:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881471:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521269.881477:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521269.881483:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521269.881494:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881499:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521269.881510:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881516:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40031600/0x53df1cebae016181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016188 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881525:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521269.881528:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881533:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521269.881536:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881541:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521269.881547:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521269.881552:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521269.881563:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881568:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521269.881572:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881578:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40030000/0x53df1cebae016157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01615e expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.881590:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521269.881597:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521269.881599:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521269.881613:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368076672:0@lo:103: 00000100:00100000:2.0:1788521269.881656:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.881688:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368077184:0@lo:103: 00000100:00100000:2.0:1788521269.881708:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.881728:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521269.881733:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368076800:0@lo:103: 00000100:00100000:2.0:1788521269.881752:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.881805:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368077056:0@lo:103: 00000100:00100000:2.0:1788521269.881825:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.881841:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521269.881847:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368076928:0@lo:103: 00000100:00100000:2.0:1788521269.881877:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521269.881908:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076672 00000100:00100000:2.0:1788521269.881913:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076672 00010000:00010000:2.0:1788521269.881933:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 17 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521269.881948:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077184 00000100:00100000:2.0:1788521269.881951:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077184 00010000:00010000:2.0:1788521269.881961:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016157 expref: 18 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521269.881971:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076800 00000100:00100000:2.0:1788521269.881974:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076800 00010000:00010000:2.0:1788521269.881995:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 19 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521269.882007:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077056 00000100:00100000:2.0:1788521269.882017:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077056 00010000:00010000:2.0:1788521269.882030:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016181 expref: 20 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521269.882041:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368076928 00000100:00100000:2.0:1788521269.882043:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368076928 00010000:00010000:2.0:1788521269.882051:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161ab expref: 21 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521269.882064:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521269.882070:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+21:3300:x1875400368076672:12345-0@lo:103: 00010000:00010000:2.0:1788521269.882081:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521269.882087:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 21 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882098:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 21 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882114:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521269.882145:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+21:3300:x1875400368076672:12345-0@lo:103: Request processed in 75us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.882152:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521269.882166:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521269.882172:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3300:x1875400368077184:12345-0@lo:103: 00010000:00010000:2.0:1788521269.882179:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521269.882184:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016157 expref: 20 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882192:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016157 expref: 20 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882212:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521269.882235:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3300:x1875400368077184:12345-0@lo:103: Request processed in 64us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.882241:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521269.882254:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521269.882260:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368076800:12345-0@lo:103: 00010000:00010000:2.0:1788521269.882267:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521269.882272:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 19 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882280:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 19 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882289:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521269.882310:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368076800:12345-0@lo:103: Request processed in 51us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.882316:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521269.882327:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521269.882333:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3303:x1875400368077056:12345-0@lo:103: 00010000:00010000:2.0:1788521269.882340:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521269.882344:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016181 expref: 18 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882351:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016181 expref: 18 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882361:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521269.882388:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3303:x1875400368077056:12345-0@lo:103: Request processed in 55us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.882400:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521269.882413:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521269.882419:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3303:x1875400368076928:12345-0@lo:103: 00010000:00010000:2.0:1788521269.882427:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521269.882432:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161ab expref: 17 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882440:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0161ab expref: 17 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882452:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882461:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882475:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882483:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882490:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882497:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882501:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166e400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521269.882505:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882519:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882528:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521269.882537:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521269.882561:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3303:x1875400368076928:12345-0@lo:103: Request processed in 142us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521269.882567:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521269.882607:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368076800:0@lo:103: 00000100:00100000:2.0:1788521269.882617:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368076672:0@lo:103: 00000100:00100000:2.0:1788521269.882623:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368077184:0@lo:103: 00000100:00100000:2.0:1788521269.882665:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368076928:0@lo:103: 00000100:00100000:2.0:1788521269.882672:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368077056:0@lo:103: 00010000:00010000:1.0:1788521269.883535:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521269.883589:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0161f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0161f1 expref: 16 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.883603:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076032:0@lo:104: 00010000:00010000:1.0:1788521269.883613:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40030c00/0x53df1cebae0161ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0161c7 expref: 15 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.883635:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75413800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076160:0@lo:104: 00010000:00010000:1.0:1788521269.883646:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166f400/0x53df1cebae0161b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0161ab expref: 14 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.883655:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076288:0@lo:104: 00010000:00010000:1.0:1788521269.883664:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae016188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016181 expref: 13 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.883672:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076416:0@lo:104: 00010000:00010000:1.0:1788521269.883682:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01615e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016157 expref: 12 pid: 5828 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521269.883691:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5825:1875400368076544:0@lo:104: 00010000:00010000:1.0:1788521269.883714:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.883733:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.883738:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521269.883757:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01620d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521269.884085:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788521270.013097:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:7636:x1875400368075904:12345-0@lo:253: Request processed in 161818us (162615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.013112:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788521270.013224:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368075904:0@lo:253: 10000000:01000000:0.0:1788521270.013240:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788521270.013257:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788521270.013259:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521270.013260:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521270.013261:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788521270.013263:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521270.013264:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521270.013265:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521270.013267:0:7636:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788521270.013269:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521270.013270:0:7636:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788521270.013301:0:7636:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0a7f66c000 from lustre-OST0001 10000000:01000000:0.0:1788521270.013338:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788521270.013342:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788521270.013349:0:7636:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c0a489a19c0 local copy 10000000:01000000:0.0:1788521270.013354:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788521270.013395:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.013406:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.013415:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521270.013435:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077312:0@lo:101: 00000100:00100000:0.0:1788521270.013472:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.013524:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75782a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521270.013590:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077312 00000100:00100000:1.0:1788521270.013597:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077312 00000100:00100000:1.0:1788521270.013663:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788521270.013673:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+11:7636:x1875400368077312:12345-0@lo:101: 00010000:00010000:1.0:1788521270.013686:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521270.013701:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01621b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016214 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.013724:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01621b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016214 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.013734:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01621b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016214 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.013754:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166e400, rc 0) 00000100:00100000:1.0:1788521270.013832:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:7636:x1875400368077312:12345-0@lo:101: Request processed in 161us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521270.013839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788521270.014150:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077312:0@lo:101: 00010000:00010000:3.0:1788521270.014175:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.014185:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521270.014283:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077440:0@lo:501: 00000100:00100000:3.0:1788521270.014311:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521270.014343:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48f13a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.014407:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077440 00000100:00100000:0.0:1788521270.014412:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077440 00000100:00100000:0.0:1788521270.014447:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788521270.014454:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:7636:x1875400368077440:12345-0@lo:501: 00000100:00100000:0.0:1788521270.014872:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:7636:x1875400368077440:12345-0@lo:501: Request processed in 418us (558us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521270.014890:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788521270.015505:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077440:0@lo:501: 10000000:01000000:3.0:1788521270.015525:0:7636:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521270.015562:0:7636:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521270.015569:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.015577:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.015584:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.015710:0:7636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788521270.015735:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0a7f66c000 10000000:01000000:3.0:1788521270.015752:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521270.015758:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788521270.015761:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521270.015765:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788521270.015768:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521270.016044:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.016053:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.016063:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521270.016080:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077568:0@lo:101: 00000100:00100000:3.0:1788521270.016126:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521270.016163:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48f136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521270.016265:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077568 00000100:00100000:1.0:1788521270.016277:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077568 00000100:00100000:1.0:1788521270.016317:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521270.016325:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:7636:x1875400368077568:12345-0@lo:101: 00010000:00010000:1.0:1788521270.016335:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521270.016345:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016222 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.016365:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016222 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.016375:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016222 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.016383:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166ec00, rc 0) 00000100:00100000:1.0:1788521270.016423:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077568:12345-0@lo:101: Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521270.016429:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788521270.016523:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077568:0@lo:101: 00010000:00010000:3.0:1788521270.016535:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.016545:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521270.016651:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077696:0@lo:501: 00000100:00100000:3.0:1788521270.016675:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521270.016695:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48f136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521270.016922:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077696 00000100:00100000:1.0:1788521270.016926:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077696 00000100:00100000:1.0:1788521270.016956:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521270.016963:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077696:12345-0@lo:501: 00000100:00100000:1.0:1788521270.017158:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077696:12345-0@lo:501: Request processed in 195us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521270.017165:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788521270.017294:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077696:0@lo:501: 00000100:00100000:0.0:1788521270.017323:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077824:0@lo:503: 00000100:00100000:0.0:1788521270.017364:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.017397:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75782a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521270.017450:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077824 00000100:00100000:3.0:1788521270.017455:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077824 00000100:00100000:3.0:1788521270.017488:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521270.017496:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077824:12345-0@lo:503: 00000100:00100000:3.0:1788521270.017663:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077824:12345-0@lo:503: Request processed in 167us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.017669:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521270.017797:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077824:0@lo:503: 00000040:00080000:0.0:1788521270.018084:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521270.018144:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077952:0@lo:502: 00000100:00100000:0.0:1788521270.018186:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.018212:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75782a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.018231:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368077952 00000100:00100000:0.0:1788521270.018235:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368077952 00000100:00100000:0.0:1788521270.018257:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788521270.018263:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077952:12345-0@lo:502: 00000100:00100000:0.0:1788521270.018407:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368077952:12345-0@lo:502: Request processed in 144us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.018413:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788521270.018453:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368077952:0@lo:502: 00000040:00080000:0.0:1788521270.018695:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788521270.018740:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788521270.018792:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788521270.018855:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788521270.018894:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788521270.018928:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788521270.018951:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078080:0@lo:502: 00000100:00100000:0.0:1788521270.018994:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.019013:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75782a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.019029:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078080 00000100:00100000:0.0:1788521270.019033:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078080 00000100:00100000:0.0:1788521270.019052:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521270.019058:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078080:12345-0@lo:502: 00000100:00100000:0.0:1788521270.019184:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078080:12345-0@lo:502: Request processed in 125us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.019191:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521270.019236:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078080:0@lo:502: 00000040:00080000:0.0:1788521270.019314:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788521270.019322:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788521270.022306:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788521270.022318:0:7643:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788521270.022324:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521270.022327:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788521270.022333:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521270.022375:0:7643:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c0a75c499c0) 00000020:00000080:1.0:1788521270.022401:0:7643:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788521270.022409:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788521270.022483:0:7643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a7f66c000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788521270.022492:0:7643:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788521270.022499:0:7643:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x53df1cebae016237 00010000:00010000:2.0:1788521270.024740:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521270.024763:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.024861:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521270.024866:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.024877:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521270.024972:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521270.024978:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521270.025019:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.025026:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521270.025063:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.025072:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae016214 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x53df1cebae01621b expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.025089:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521270.025091:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521270.025093:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521270.025107:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521270.025127:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368078208:0@lo:103: 00000100:00100000:2.0:1788521270.025189:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.025245:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078208 00000100:00100000:2.0:1788521270.025252:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078208 00000100:00100000:2.0:1788521270.025298:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521270.025307:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3300:x1875400368078208:12345-0@lo:103: 00010000:00010000:2.0:1788521270.025319:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521270.025334:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01621b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016214 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.025348:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521270.025393:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3300:x1875400368078208:12345-0@lo:103: Request processed in 87us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521270.025400:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521270.025437:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368078208:0@lo:103: 00010000:00010000:1.0:1788521270.029276:0:7643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788521270.029602:0:7643:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788521270.036659:0:7643:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788521270.037648:0:7643:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788521270.046725:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788521270.047439:0:7643:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788521270.049692:0:7643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788521270.049707:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521270.049715:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521270.049718:0:7643:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788521270.049722:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521270.049727:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521270.049729:0:7643:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521270.049732:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521270.049734:0:7643:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788521270.050015:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521270.050021:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521270.050022:0:7643:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788521270.050026:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788521270.050373:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788521270.050400:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788521270.050426:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.050438:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521270.050447:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a7f66c000 from 1 10000000:01000000:0.0:1788521270.050450:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521270.050486:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.050494:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.050516:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521270.050540:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078336:0@lo:101: 00000100:00100000:0.0:1788521270.050616:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.050670:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51291900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521270.050811:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078336 00000100:00100000:3.0:1788521270.050819:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078336 00000100:00100000:3.0:1788521270.050862:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521270.050871:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:7636:x1875400368078336:12345-0@lo:101: 00010000:00010000:3.0:1788521270.050883:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521270.051074:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01623e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.051099:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01623e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.051110:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01623e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.051119:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0600, rc 0) 00000100:00100000:3.0:1788521270.051161:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078336:12345-0@lo:101: Request processed in 291us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.051168:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788521270.051279:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078336:0@lo:101: 00010000:00010000:0.0:1788521270.051293:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.051303:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521270.051417:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078464:0@lo:501: 00000100:00100000:0.0:1788521270.051446:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.051468:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51291900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521270.051526:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078464 00000100:00100000:3.0:1788521270.051531:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078464 00000100:00100000:3.0:1788521270.051565:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788521270.051571:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078464:12345-0@lo:501: 00000100:00100000:3.0:1788521270.052147:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078464:12345-0@lo:501: Request processed in 574us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.052155:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788521270.052316:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078464:0@lo:501: 00000100:00100000:0.0:1788521270.052353:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078592:0@lo:503: 00000100:00100000:0.0:1788521270.052394:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.052414:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51291900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521270.052465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078592 00000100:00100000:3.0:1788521270.052470:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078592 00000100:00100000:3.0:1788521270.052505:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788521270.052512:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078592:12345-0@lo:503: 00000100:00100000:3.0:1788521270.053241:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078592:12345-0@lo:503: Request processed in 727us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.053249:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788521270.060073:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078592:0@lo:503: 00000040:00080000:2.0:1788521270.060410:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521270.060496:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078720:0@lo:502: 00000100:00100000:2.0:1788521270.060567:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.060682:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521270.062700:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078720 00000100:00100000:3.0:1788521270.062712:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078720 00000100:00100000:3.0:1788521270.063092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788521270.063103:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078720:12345-0@lo:502: 00000100:00100000:3.0:1788521270.063397:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078720:12345-0@lo:502: Request processed in 296us (2830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.063405:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788521270.063493:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078720:0@lo:502: 00000040:00080000:2.0:1788521270.063843:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788521270.063905:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788521270.063940:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078848:0@lo:502: 00000100:00100000:2.0:1788521270.063982:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.064559:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.064646:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078848 00000100:00100000:0.0:1788521270.064653:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078848 00000100:00100000:0.0:1788521270.064689:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788521270.064697:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078848:12345-0@lo:502: 00000100:00100000:0.0:1788521270.065211:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078848:12345-0@lo:502: Request processed in 513us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.065228:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788521270.065431:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078848:0@lo:502: 00000040:00080000:2.0:1788521270.065562:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788521270.065575:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788521270.066535:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521270.066545:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521270.066548:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788521270.066555:0:7647:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a7f66c000 00000020:00000080:1.0:1788521270.066558:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788521270.066577:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521270.066581:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521270.066582:0:7647:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788521270.066585:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788521270.067195:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788521270.067222:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521270.067245:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.067257:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521270.067301:0:7636:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521270.067304:0:7636:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0a7f66c000 10000000:01000000:2.0:1788521270.067306:0:7636:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0a7f66c000 10000000:01000000:2.0:1788521270.067310:0:7636:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521270.067315:0:7636:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a7f66c000 from 1 10000000:01000000:2.0:1788521270.067317:0:7636:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521270.067349:0:7636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.067358:0:7636:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.067367:0:7636:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521270.067387:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078976:0@lo:101: 00000100:00100000:2.0:1788521270.067442:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.067485:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.067539:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368078976 00000100:00100000:0.0:1788521270.067547:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368078976 00000100:00100000:0.0:1788521270.067593:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788521270.067602:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368078976:12345-0@lo:101: 00010000:00010000:0.0:1788521270.067726:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521270.067749:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01624c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.068009:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01624c expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.068024:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01624c expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.068034:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4600, rc 0) 00000100:00100000:0.0:1788521270.068087:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368078976:12345-0@lo:101: Request processed in 485us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.068094:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521270.068171:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368078976:0@lo:101: 00010000:00010000:2.0:1788521270.068184:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.068207:0:7636:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521270.068298:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079104:0@lo:501: 00000100:00100000:2.0:1788521270.068326:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.068352:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.068448:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079104 00000100:00100000:0.0:1788521270.068453:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079104 00000100:00100000:0.0:1788521270.068484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788521270.068491:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079104:12345-0@lo:501: 00000100:00100000:0.0:1788521270.069037:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079104:12345-0@lo:501: Request processed in 545us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.069046:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788521270.069126:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079104:0@lo:501: 00000100:00100000:2.0:1788521270.069156:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079232:0@lo:503: 00000100:00100000:2.0:1788521270.069197:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.069228:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.069267:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079232 00000100:00100000:0.0:1788521270.069272:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079232 00000100:00100000:0.0:1788521270.069307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788521270.069314:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079232:12345-0@lo:503: 00000100:00100000:0.0:1788521270.069531:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079232:12345-0@lo:503: Request processed in 217us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.069539:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788521270.073153:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079232:0@lo:503: 00000040:00080000:0.0:1788521270.078512:0:7636:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521270.080974:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079360:0@lo:502: 00000100:00100000:0.0:1788521270.081178:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.081265:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75d0c180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521270.086114:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079360 00000100:00100000:1.0:1788521270.086129:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079360 00000100:00100000:2.0:1788521270.090293:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788521270.090310:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079360:12345-0@lo:502: 00000100:00100000:2.0:1788521270.090618:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079360:12345-0@lo:502: Request processed in 312us (9441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521270.090636:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788521270.090731:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079360:0@lo:502: 00000040:00080000:0.0:1788521270.091086:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788521270.091155:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788521270.091191:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788521270.091236:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788521270.091271:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788521270.091333:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788521270.091373:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788521270.091423:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788521270.091475:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788521270.091514:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788521270.091547:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788521270.091587:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788521270.091617:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788521270.096155:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788521270.096249:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788521270.096289:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788521270.096325:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788521270.096374:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788521270.096410:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788521270.096446:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788521270.096511:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788521270.096539:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788521270.096565:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788521270.096641:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788521270.096674:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788521270.096700:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788521270.096737:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788521270.096764:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788521270.096814:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788521270.096853:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788521270.096881:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788521270.097511:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788521270.097543:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788521270.097587:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788521270.097645:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788521270.097688:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788521270.097716:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788521270.097762:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079488:0@lo:502: 00000100:00100000:0.0:1788521270.098382:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.102587:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75d0c180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521270.105330:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079488 00000100:00100000:3.0:1788521270.105345:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079488 00000100:00100000:3.0:1788521270.105398:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521270.105408:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079488:12345-0@lo:502: 00000100:00100000:3.0:1788521270.105723:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368079488:12345-0@lo:502: Request processed in 316us (7342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521270.105732:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788521270.108336:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368079488:0@lo:502: 00000040:00080000:0.0:1788521270.108516:0:7636:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788521270.108535:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788521270.110819:0:7648:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788521270.110836:0:7648:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c0a458e99c0) 00000020:00000080:0.0:1788521270.110857:0:7648:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788521270.111183:0:7648:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a7f66c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788521270.111188:0:7648:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a7f66c000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788521270.111191:0:7648:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a7f66c000 3 00010000:00080000:0.0:1788521270.111218:0:7648:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a7ab95800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1788521270.114199:0:7648:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788521270.114483:0:7648:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788521270.114521:0:7648:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521270.114535:0:7648:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x53df1cebae016261 00000100:00080000:0.0:1788521270.114545:0:7648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521270.114552:0:7648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0a7ab95800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521270.114587:0:7648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a458e3100 x1875400368079616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521270.114619:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368079616:0@lo:38: 00000100:00100000:0.0:1788521270.114698:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.114763:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079616 00000100:00100000:0.0:1788521270.114770:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079616 00000100:00100000:0.0:1788521270.115044:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521270.115052:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875400368079616:12345-0@lo:38: 00010000:00080000:0.0:1788521270.115075:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1788521270.115637:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x53df1cebae016268 00000004:00100000:0.0:1788521270.115655:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521270.115689:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab93000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521270.115763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875400368079616:12345-0@lo:38: Request processed in 710us (1064us total) trans 0 rc 0/0 00010000:00080000:2.0:1788521270.115913:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a458e3100 x1875400368079616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521270.115924:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521270.115931:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788521270.115939:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788521270.115943:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521270.115945:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab95800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521270.115951:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368079616:0@lo:38: 00000100:00100000:0.0:1788521270.116224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788521270.116254:0:7648:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788521270.116498:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368079872:0@lo:400: 00000100:00100000:2.0:1788521270.116544:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.116569:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521270.116574:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368079744:0@lo:400: 00000100:00100000:2.0:1788521270.116592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.116612:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368080000:0@lo:400: 00000100:00100000:2.0:1788521270.116648:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521270.116731:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079872 00000100:00100000:0.0:1788521270.116737:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079872 00000100:00080000:2.0:1788521270.116975:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521270.117051:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368079744 00000100:00100000:0.0:1788521270.117055:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368079744 00000100:00100000:0.0:1788521270.117079:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521270.117209:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368079872:12345-0@lo:400: 00000100:00100000:0.0:1788521270.117271:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368079872:12345-0@lo:400: Request processed in 185us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.117279:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521270.117295:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521270.117302:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368079744:12345-0@lo:400: 00000100:00100000:0.0:1788521270.117329:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368079744:12345-0@lo:400: Request processed in 28us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.117334:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788521270.117373:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75c1ad80 x1875400368079744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521270.117385:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368079744:0@lo:400: 00010000:00080000:0.0:1788521270.117397:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75c19180 x1875400368079872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521270.117405:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368079872:0@lo:400: 00000100:00100000:2.0:1788521270.118228:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080000 00000100:00100000:2.0:1788521270.118236:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080000 00000100:00100000:2.0:1788521270.118285:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521270.118294:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368080000:12345-0@lo:400: 00000100:00100000:2.0:1788521270.118350:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368080000:12345-0@lo:400: Request processed in 58us (1701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521270.118358:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788521270.118391:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75c1b480 x1875400368080000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521270.118402:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368080000:0@lo:400: 00000040:00080000:0.0:1788521270.118584:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1788521270.118755:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521270.119027:0:7649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7649:1875400368080128:0@lo:901: 00000100:00100000:2.0:1788521270.119068:0:7649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.119886:0:7649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.120022:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080128 00000100:00100000:0.0:1788521270.120030:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080128 00000100:00100000:0.0:1788521270.120076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521270.120083:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7649:x1875400368080128:12345-0@lo:901: 00000100:00080000:1.0:1788521270.120294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:2.0:1788521270.121326:0:7636:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788521270.121358:0:7636:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521270.121379:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.121390:0:7636:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521270.121444:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521270.121447:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521270.121448:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521270.121450:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521270.121451:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521270.121452:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521270.121454:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521270.121455:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521270.121457:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521270.121458:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521270.121460:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521270.121463:0:7636:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788521270.121466:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521270.121467:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521270.121468:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521270.121469:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521270.121470:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521270.121471:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521270.121472:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521270.121474:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521270.121474:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521270.121476:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521270.121477:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521270.121495:0:7636:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788521270.121510:0:7636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368080256:0@lo:253: 00000100:00100000:2.0:1788521270.121564:0:7636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.121596:0:7636:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521270.125188:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7649:x1875400368080128:12345-0@lo:901: Request processed in 5095us (6109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521270.125202:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788521270.125297:0:7649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75c1b480 x1875400368080128/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788521286 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521270.125311:0:7649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7649:1875400368080128:0@lo:901: 00000100:00100000:2.0:1788521270.125887:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080256 00000100:00100000:2.0:1788521270.125967:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080256 00000100:00100000:2.0:1788521270.126015:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788521270.126030:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7636:x1875400368080256:12345-0@lo:253: 20000000:01000000:2.0:1788521270.126067:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788521270.126080:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788521270.259833:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788521270.259849:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788521270.259872:0:5848:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788521270.259876:0:5848:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788521270.260203:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.260223:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.260231:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.260272:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.260287:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 14 pid: 5826 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521270.260302:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875400368080384:0@lo:104: 00000100:00100000:2.0:1788521270.260364:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.260428:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521270.260721:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080384 00000100:00100000:1.0:1788521270.260729:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080384 00000100:00100000:1.0:1788521270.260804:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521270.260814:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5848:x1875400368080384:12345-0@lo:104: 00010000:00010000:1.0:1788521270.260828:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521270.260901:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521270.260919:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:5848:x1875400368080384:12345-0@lo:104: Request processed in 108us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521270.260926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521270.261207:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5848:1875400368080384:0@lo:104: 00010000:00010000:2.0:1788521270.261226:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261243:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521270.261248:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261262:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1a00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521270.261267:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261276:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521270.261283:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521270.261288:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521270.261325:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261332:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521270.261348:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261356:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1a00/0x53df1cebae0161b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0161c0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261372:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521270.261374:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521270.261375:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521270.261382:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521270.261393:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368080512:0@lo:103: 00000100:00100000:2.0:1788521270.261430:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521270.261458:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080512 00000100:00100000:2.0:1788521270.261461:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080512 00010000:00010000:2.0:1788521270.261487:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 15 pid: 5826 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521270.261508:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521270.261514:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:3300:x1875400368080512:12345-0@lo:103: 00010000:00010000:2.0:1788521270.261524:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521270.261528:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 15 pid: 5826 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261538:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 15 pid: 5826 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261552:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0161c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0161b9 expref: 15 pid: 5826 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261565:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261573:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788521270.261585:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003612442s 00010000:00010000:2.0:1788521270.261590:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261596:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.261603:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521270.262188:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521270.264010:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.264038:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82045600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521270.264043:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.264053:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.264077:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.264138:0:5848:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521270.264147:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521270.264160:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521270.264161:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82045600/0x53df1cebae01626f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521270.264235:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46426050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3300:x1875400368080512:12345-0@lo:103: Request processed in 2718us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521270.264245:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521270.264331:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368080512:0@lo:103: 00000100:00100000:1.0:1788521270.291102:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:7636:x1875400368080256:12345-0@lo:253: Request processed in 165053us (169517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521270.291117:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788521270.291331:0:7636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:02b855e8-b82d-4a25-90ff-ed0c016d947b:7636:1875400368080256:0@lo:253: 10000000:01000000:2.0:1788521270.291345:0:7636:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788521270.291348:0:7636:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521270.291351:0:7636:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521270.291352:0:7636:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521270.291354:0:7636:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521270.291355:0:7636:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521270.291356:0:7636:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521270.291358:0:7636:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521270.291359:0:7636:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788521270.291361:0:7636:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788521270.291362:0:7636:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521270.291363:0:7636:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521270.291379:0:7636:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788521270.309282:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521270.309508:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521270.309736:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521270.310245:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521270.310972:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521270.311348:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788521270.322016:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788521270.625364:0:7636:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788521270.625372:0:7636:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788521270.625421:0:7636:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788521270.625567:0:7636:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788521270.625584:0:7636:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788521270.625610:0:7636:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788521271.272876:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521271.923902:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368080640:0@lo:13: 00000100:00100000:0.0:1788521271.923975:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521271.924056:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080640 00000100:00100000:0.0:1788521271.924064:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080640 00000100:00100000:0.0:1788521271.924110:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521271.924119:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368080640:12345-0@lo:13: 00002000:00000024:0.0:1788521271.924152:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521271.924195:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368080640:12345-0@lo:13: Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521271.924202:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788521271.924242:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368080640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521271.924259:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368080640:0@lo:13: 00010000:00010000:3.0:1788521272.297318:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521273.325953:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521274.345280:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521275.369031:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521275.500096:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368080768:0@lo:400: 00000100:00100000:2.0:1788521275.500167:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521275.500224:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368081280:0@lo:400: 00000100:00100000:2.0:1788521275.500257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521275.500282:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788521275.500288:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368081152:0@lo:400: 00000100:00100000:2.0:1788521275.500310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521275.500337:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368080896:0@lo:400: 00000100:00100000:2.0:1788521275.500359:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521275.500375:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521275.500380:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368081024:0@lo:400: 00000100:00100000:2.0:1788521275.500398:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521275.500637:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080768 00000100:00100000:2.0:1788521275.500644:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080768 00000100:00100000:2.0:1788521275.500687:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788521275.500697:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3303:x1875400368080768:12345-0@lo:400: 00000100:00100000:3.0:1788521275.500918:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081280 00000100:00100000:3.0:1788521275.500923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081280 00000100:00100000:3.0:1788521275.500961:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368080896 00000100:00100000:3.0:1788521275.500964:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368080896 00000100:00100000:3.0:1788521275.500977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081024 00000100:00100000:3.0:1788521275.500980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081024 00000100:00100000:3.0:1788521275.500994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521275.501000:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368081280:12345-0@lo:400: 00000100:00100000:3.0:1788521275.501061:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368081280:12345-0@lo:400: Request processed in 61us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521275.501068:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521275.501085:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521275.501091:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368080896:12345-0@lo:400: 00000100:00100000:3.0:1788521275.501124:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368080896:12345-0@lo:400: Request processed in 33us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521275.501130:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521275.501141:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521275.501146:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368081024:12345-0@lo:400: 00000100:00100000:3.0:1788521275.501173:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368081024:12345-0@lo:400: Request processed in 27us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521275.501179:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521275.501200:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081152 00000100:00100000:3.0:1788521275.501211:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081152 00000100:00100000:3.0:1788521275.501239:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521275.501245:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368081152:12345-0@lo:400: 00000100:00100000:3.0:1788521275.501277:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368081152:12345-0@lo:400: Request processed in 32us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521275.501282:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788521275.501301:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521275.501305:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521275.501334:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c18380 x1875400368081152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521275.501349:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368081152:0@lo:400: 00010000:00080000:3.0:1788521275.501366:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1b100 x1875400368081280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521275.501375:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368081280:0@lo:400: 00010000:00080000:3.0:1788521275.501408:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c19880 x1875400368081024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521275.501418:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368081024:0@lo:400: 00010000:00080000:3.0:1788521275.501429:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1b800 x1875400368080896/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521275.501437:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368080896:0@lo:400: 00000100:00100000:2.0:1788521275.504024:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3303:x1875400368080768:12345-0@lo:400: Request processed in 3322us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521275.504039:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521275.505948:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368080768:0@lo:400: 00010000:00010000:2.0:1788521276.392939:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521277.034573:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521277.034609:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368081408:0@lo:13: 00000100:00100000:0.0:1788521277.034684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521277.034754:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081408 00000100:00100000:0.0:1788521277.034762:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081408 00000100:00100000:0.0:1788521277.034834:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521277.034852:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368081408:12345-0@lo:13: 00002000:00000024:0.0:1788521277.034885:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521277.034929:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368081408:12345-0@lo:13: Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521277.034936:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788521277.034955:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521277.034986:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368081408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521277.035004:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368081408:0@lo:13: 00010000:00010000:0.0:1788521277.418832:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788521278.058005:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788521278.058014:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a75d22000 from 30 10000000:01000000:0.0:1788521278.058020:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788521278.058072:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.058084:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.058107:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.058134:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368081536:0@lo:101: 00000100:00100000:0.0:1788521278.058205:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.058268:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.058641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081536 00000100:00100000:1.0:1788521278.058650:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081536 00000100:00100000:1.0:1788521278.058708:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788521278.058718:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368081536:12345-0@lo:101: 00010000:00010000:1.0:1788521278.058729:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521278.058742:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016276 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.058764:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016276 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.058792:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016276 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.058802:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166e600, rc 0) 00000100:00100000:1.0:1788521278.058845:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368081536:12345-0@lo:101: Request processed in 129us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.058851:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521278.060421:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368081536:0@lo:101: 00010000:00010000:0.0:1788521278.060448:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.060480:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.060560:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368081664:0@lo:501: 00000100:00100000:0.0:1788521278.060623:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.060659:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.061193:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081664 00000100:00100000:1.0:1788521278.061201:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081664 00000100:00100000:1.0:1788521278.061254:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788521278.061264:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368081664:12345-0@lo:501: 00000100:00100000:1.0:1788521278.061540:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368081664:12345-0@lo:501: Request processed in 277us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.061556:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788521278.062955:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368081664:0@lo:501: 00000100:00100000:0.0:1788521278.063032:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368081792:0@lo:503: 00000100:00100000:0.0:1788521278.063107:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.063144:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615000 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.063800:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081792 00000100:00100000:1.0:1788521278.063808:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081792 00000100:00100000:1.0:1788521278.063850:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788521278.063859:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368081792:12345-0@lo:503: 00000100:00100000:1.0:1788521278.064236:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368081792:12345-0@lo:503: Request processed in 377us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.064245:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788521278.068001:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368081792:0@lo:503: 00000100:00100000:0.0:1788521278.070732:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7954:1875400368081920:0@lo:502: 00000100:00100000:0.0:1788521278.070845:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.070883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368081920 00000100:00100000:0.0:1788521278.070890:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368081920 00000100:00100000:0.0:1788521278.070928:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788521278.070937:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7954:x1875400368081920:12345-0@lo:502: 00000100:00100000:0.0:1788521278.075920:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7954:x1875400368081920:12345-0@lo:502: Request processed in 4976us (5066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.075935:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788521278.076019:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.076046:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7954:1875400368081920:0@lo:502: 00000100:00100000:0.0:1788521278.076126:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7954:1875400368082048:0@lo:502: 00000100:00100000:0.0:1788521278.076187:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.076211:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.078287:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082048 00000100:00100000:1.0:1788521278.078300:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082048 00000100:00100000:1.0:1788521278.078353:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788521278.078363:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7954:x1875400368082048:12345-0@lo:502: 00000100:00100000:1.0:1788521278.078634:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:7954:x1875400368082048:12345-0@lo:502: Request processed in 272us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.078642:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788521278.078770:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7954:1875400368082048:0@lo:502: 00000040:00080000:0.0:1788521278.078833:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788521278.079376:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788521278.079402:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521278.079412:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.079423:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521278.079432:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788521278.079435:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788521278.079438:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521278.079471:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.079492:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.079502:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521278.079520:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082176:0@lo:101: 00000100:00100000:1.0:1788521278.079560:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521278.079605:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0943992900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.081748:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082176 00000100:00100000:0.0:1788521278.081763:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082176 00000100:00100000:0.0:1788521278.081828:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788521278.081837:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368082176:12345-0@lo:101: 00010000:00010000:0.0:1788521278.081865:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521278.081882:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016284 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.081908:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016284 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.081919:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016284 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.081929:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5800, rc 0) 00000100:00100000:0.0:1788521278.082004:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368082176:12345-0@lo:101: Request processed in 168us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.082011:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788521278.082058:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082176:0@lo:101: 00010000:00010000:0.0:1788521278.082075:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.082084:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.082171:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082304:0@lo:501: 00000100:00100000:0.0:1788521278.082203:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.082235:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f6159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.082249:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082304 00000100:00100000:0.0:1788521278.082252:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082304 00000100:00100000:0.0:1788521278.083031:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788521278.083042:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368082304:12345-0@lo:501: 00000100:00100000:0.0:1788521278.084425:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368082304:12345-0@lo:501: Request processed in 1374us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.084436:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788521278.084522:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082304:0@lo:501: 00000100:00100000:0.0:1788521278.084595:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082432:0@lo:503: 00000100:00100000:0.0:1788521278.084654:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.084692:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f6159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.084713:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082432 00000100:00100000:0.0:1788521278.084719:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082432 00000100:00100000:0.0:1788521278.085394:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788521278.085403:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368082432:12345-0@lo:503: 00000100:00100000:0.0:1788521278.085651:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368082432:12345-0@lo:503: Request processed in 249us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.085659:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788521278.085717:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082432:0@lo:503: 00000100:00100000:2.0:1788521278.095333:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7955:1875400368082560:0@lo:502: 00000100:00100000:2.0:1788521278.095448:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.095530:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.095593:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082560 00000100:00100000:2.0:1788521278.095600:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082560 00000100:00100000:2.0:1788521278.095655:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788521278.095664:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:7955:x1875400368082560:12345-0@lo:502: 00000100:00100000:2.0:1788521278.099595:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:7955:x1875400368082560:12345-0@lo:502: Request processed in 3923us (4139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.099628:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521278.100222:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7955:1875400368082560:0@lo:502: 00000020:01000000:0.0:1788521278.100259:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521278.100274:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521278.100276:0:7955:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788521278.100284:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788521278.100286:0:7955:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788521278.100319:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7955:1875400368082688:0@lo:502: 00000100:00100000:0.0:1788521278.100368:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.100399:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a605ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521278.100996:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082688 00000100:00100000:3.0:1788521278.101004:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082688 00000100:00100000:3.0:1788521278.101052:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788521278.101061:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:7955:x1875400368082688:12345-0@lo:502: 00000100:00100000:3.0:1788521278.101822:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:7955:x1875400368082688:12345-0@lo:502: Request processed in 760us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521278.101837:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788521278.102312:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7955:1875400368082688:0@lo:502: 00000020:01000000:0.0:1788521278.102352:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521278.102358:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521278.102360:0:7955:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788521278.102366:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788521278.102555:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788521278.102584:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788521278.102595:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.102606:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521278.102615:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788521278.102618:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a4f90d800 from 30 10000000:01000000:2.0:1788521278.102621:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521278.102652:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.102659:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.102667:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521278.102685:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082816:0@lo:101: 00000100:00100000:2.0:1788521278.103545:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.103595:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521278.104173:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082816 00000100:00100000:3.0:1788521278.104181:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082816 00000100:00100000:3.0:1788521278.104221:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788521278.104230:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368082816:12345-0@lo:101: 00010000:00010000:3.0:1788521278.104243:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521278.104257:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016292 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521278.104281:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016292 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521278.104291:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016292 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521278.104300:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0200, rc 0) 00000100:00100000:3.0:1788521278.104431:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368082816:12345-0@lo:101: Request processed in 201us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521278.104438:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521278.109693:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082816:0@lo:101: 00010000:00010000:0.0:1788521278.109724:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.109737:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.109856:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082944:0@lo:501: 00000100:00100000:0.0:1788521278.109932:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521278.110229:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368082944 00000100:00100000:1.0:1788521278.110237:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368082944 00000100:00100000:1.0:1788521278.110285:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788521278.110294:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368082944:12345-0@lo:501: 00000100:00100000:1.0:1788521278.110556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368082944:12345-0@lo:501: Request processed in 262us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.110564:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788521278.110754:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a605ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.110803:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368082944:0@lo:501: 00000100:00100000:0.0:1788521278.110846:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083072:0@lo:503: 00000100:00100000:0.0:1788521278.110897:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.110917:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a605ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.110990:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083072 00000100:00100000:2.0:1788521278.110995:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083072 00000100:00100000:2.0:1788521278.111022:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788521278.111030:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368083072:12345-0@lo:503: 00000100:00100000:2.0:1788521278.111194:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368083072:12345-0@lo:503: Request processed in 164us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.111207:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788521278.111580:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083072:0@lo:503: 00000100:00100000:1.0:1788521278.112260:0:7956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7956:1875400368083200:0@lo:502: 00000100:00100000:1.0:1788521278.112308:0:7956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521278.112340:0:7956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c09439923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.112381:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083200 00000100:00100000:2.0:1788521278.112387:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083200 00000100:00100000:2.0:1788521278.112427:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788521278.112435:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:7956:x1875400368083200:12345-0@lo:502: 00000100:00100000:2.0:1788521278.112930:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:7956:x1875400368083200:12345-0@lo:502: Request processed in 494us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.112938:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788521278.125146:0:7956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7956:1875400368083200:0@lo:502: 00000100:00100000:1.0:1788521278.125306:0:7956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7956:1875400368083328:0@lo:502: 00000100:00100000:1.0:1788521278.125372:0:7956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521278.125421:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083328 00000100:00100000:1.0:1788521278.125427:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083328 00000100:00100000:1.0:1788521278.125469:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521278.125477:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:7956:x1875400368083328:12345-0@lo:502: 00000100:00100000:1.0:1788521278.125720:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:7956:x1875400368083328:12345-0@lo:502: Request processed in 242us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.125728:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521278.125800:0:7956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c09439923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.125815:0:7956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7956:1875400368083328:0@lo:502: 00000040:00080000:1.0:1788521278.125834:0:7956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788521278.131580:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788521278.131613:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788521278.131625:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.131637:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521278.131648:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788521278.131651:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c0a4f90d800 from 5 10000000:01000000:0.0:1788521278.131654:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521278.132796:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.132810:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.132822:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.132848:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083456:0@lo:101: 00000100:00100000:0.0:1788521278.133619:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.133667:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a605ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.134367:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083456 00000100:00100000:2.0:1788521278.134753:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083456 00000100:00100000:2.0:1788521278.134843:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788521278.134853:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368083456:12345-0@lo:101: 00010000:00010000:2.0:1788521278.134870:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521278.135381:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a82044c00/0x53df1cebae0162a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0162a0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.149619:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a82044c00/0x53df1cebae0162a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0162a0 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.149640:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a82044c00/0x53df1cebae0162a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0162a0 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.149650:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82044c00, rc 0) 00000100:00100000:0.0:1788521278.149754:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368083456:12345-0@lo:101: Request processed in 14901us (16136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.149764:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521278.158676:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083456:0@lo:101: 00010000:00010000:1.0:1788521278.158717:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521278.158729:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521278.158838:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083584:0@lo:256: 00000100:00100000:1.0:1788521278.158911:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521278.158953:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c09439923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.162996:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083584 00000100:00100000:0.0:1788521278.163012:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083584 00000100:00100000:0.0:1788521278.163068:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788521278.163079:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368083584:12345-0@lo:256: 20000000:01000000:0.0:1788521278.163113:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788521278.163134:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788521278.163137:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788521278.163265:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368083584:12345-0@lo:256: Request processed in 187us (4354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.163273:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788521278.163324:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083584:0@lo:256: 10000000:01000000:0.0:1788521278.163665:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521278.163675:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.163696:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521278.163707:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788521278.163709:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788521278.163712:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521278.163743:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.163751:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.163795:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.163813:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083712:0@lo:101: 00000100:00100000:0.0:1788521278.163848:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.163878:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.163904:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083712 00000100:00100000:0.0:1788521278.163908:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083712 00000100:00100000:0.0:1788521278.163935:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521278.163941:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368083712:12345-0@lo:101: 00010000:00010000:0.0:1788521278.163949:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521278.163962:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0162ae expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.164157:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0162ae expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.164169:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0162ae expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.164178:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5600, rc 0) 00000100:00100000:0.0:1788521278.164240:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368083712:12345-0@lo:101: Request processed in 299us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.164247:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521278.167145:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083712:0@lo:101: 00010000:00010000:0.0:1788521278.167171:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521278.167201:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521278.167277:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083840:0@lo:501: 00000100:00100000:0.0:1788521278.167322:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.167357:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521278.167372:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083840 00000100:00100000:0.0:1788521278.167376:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083840 00000100:00100000:0.0:1788521278.167419:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521278.167426:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368083840:12345-0@lo:501: 00000100:00100000:0.0:1788521278.167662:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368083840:12345-0@lo:501: Request processed in 235us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.167670:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521278.168169:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083840:0@lo:501: 00000100:00100000:0.0:1788521278.168203:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083968:0@lo:503: 00000100:00100000:0.0:1788521278.168240:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.168343:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f615000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.173525:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368083968 00000100:00100000:2.0:1788521278.173540:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368083968 00000100:00100000:2.0:1788521278.173612:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788521278.173622:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368083968:12345-0@lo:503: 00000100:00100000:2.0:1788521278.174847:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368083968:12345-0@lo:503: Request processed in 1222us (6600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.174857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788521278.176584:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368083968:0@lo:503: 00000100:00100000:0.0:1788521278.196345:0:7962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7962:1875400368084096:0@lo:502: 00000100:00100000:0.0:1788521278.196451:0:7962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.196492:0:7962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4546a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.196635:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084096 00000100:00100000:2.0:1788521278.196643:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084096 00000100:00100000:2.0:1788521278.196698:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788521278.196708:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:7962:x1875400368084096:12345-0@lo:502: 00000100:00100000:2.0:1788521278.198369:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:7962:x1875400368084096:12345-0@lo:502: Request processed in 1656us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.198380:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788521278.199850:0:7962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7962:1875400368084096:0@lo:502: 00000020:01000000:0.0:1788521278.199908:0:7962:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788521278.199917:0:7962:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788521278.199932:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521278.199935:0:7962:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788521278.199943:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788521278.199947:0:7962:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:0.0:1788521278.200169:0:7962:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788521278.200173:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521278.200203:0:7962:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c09413319c0) 00000020:00000080:0.0:1788521278.200227:0:7962:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788521278.200235:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788521278.200318:0:7962:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788521278.200323:0:7962:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788521278.200333:0:7962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0162c3 00010000:00080000:0.0:1788521278.200372:0:7962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a6dc8f000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1788521278.201640:0:7962:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788521278.203804:0:7962:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788521278.203824:0:7962:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788521278.204434:0:7962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521278.204673:0:7962:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521278.204722:0:7962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788521278.204811:0:7962:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788521278.209349:0:7964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521278.209355:0:7964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788521278.211473:0:7962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521278.211487:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788521278.211523:0:7962:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788521278.211544:0:7962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0162ca 00000100:00080000:2.0:1788521278.211554:0:7962:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521278.211560:0:7962:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0a6dc8f000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521278.211607:0:7962:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a75c19880 x1875400368084224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788521278.211633:0:7962:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788521278.211682:0:7962:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788521278.211829:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368084224:0@lo:8: 00000100:00100000:3.0:1788521278.211895:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788521278.212101:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521278.212103:0:7962:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788521278.212108:0:7962:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521278.212111:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521278.212112:0:7962:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788521278.212115:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788521278.212116:0:7962:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788521278.212141:0:7962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7962:1875400368084352:0@lo:502: 00000100:00100000:2.0:1788521278.212190:0:7962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.212248:0:7962:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.214318:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368084608:0@lo:400: 00000100:00100000:2.0:1788521278.214392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.214426:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521278.214433:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368084736:0@lo:400: 00000100:00100000:2.0:1788521278.214460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.216388:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368084480:0@lo:400: 00000100:00100000:0.0:1788521278.216451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.216493:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521278.216500:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368084864:0@lo:400: 00000100:00100000:0.0:1788521278.216521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.216558:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084224 00000100:00100000:0.0:1788521278.216566:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084224 00000100:00100000:0.0:1788521278.216609:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084736 00000100:00100000:0.0:1788521278.216612:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084736 00000100:00100000:0.0:1788521278.216641:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521278.216649:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368084736:12345-0@lo:400: 00000100:00100000:0.0:1788521278.216725:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368084736:12345-0@lo:400: Request processed in 77us (2264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.216732:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521278.216751:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521278.216755:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1875400368084224:12345-0@lo:8: 00010000:00080000:0.0:1788521278.216794:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1788521278.216827:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0162d1 00002000:00100000:0.0:1788521278.216840:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c0a7f2b0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788521278.216845:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788521278.216849:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788521278.216986:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788521278.217160:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521278.217185:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f2b2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521278.217228:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1875400368084224:12345-0@lo:8: Request processed in 471us (5332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.217234:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521278.217260:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084608 00000100:00100000:0.0:1788521278.217263:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084608 00000100:00100000:0.0:1788521278.217294:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084480 00000100:00100000:0.0:1788521278.217297:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084480 00000100:00100000:0.0:1788521278.217306:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084864 00000100:00100000:0.0:1788521278.217308:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084864 00000100:00100000:0.0:1788521278.217321:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521278.217327:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368084608:12345-0@lo:400: 00000100:00100000:0.0:1788521278.217360:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368084608:12345-0@lo:400: Request processed in 33us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.217367:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521278.217390:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521278.217396:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368084480:12345-0@lo:400: 00000100:00100000:0.0:1788521278.217430:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368084480:12345-0@lo:400: Request processed in 34us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.217436:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521278.217446:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521278.217452:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368084864:12345-0@lo:400: 00000100:00100000:0.0:1788521278.217476:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368084864:12345-0@lo:400: Request processed in 25us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521278.217482:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788521278.217524:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c19180 x1875400368084736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521278.217539:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368084736:0@lo:400: 00010000:00080000:0.0:1788521278.217551:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1b480 x1875400368084608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521278.217560:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368084608:0@lo:400: 00000100:00080000:0.0:1788521278.217593:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788521278.217612:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1ad80 x1875400368084864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521278.217620:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368084864:0@lo:400: 00010000:00080000:0.0:1788521278.217629:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c18380 x1875400368084480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521278.217636:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368084480:0@lo:400: 00010000:00080000:0.0:1788521278.217677:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c19880 x1875400368084224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521278.217689:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521278.217697:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788521278.217704:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521278.217709:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788521278.217712:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a6dc8f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788521278.217733:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521278.217739:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368084224:0@lo:8: 00000100:00100000:3.0:1788521278.221344:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084352 00000100:00100000:3.0:1788521278.221358:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084352 00000004:00080000:3.0:1788521278.221385:0:7964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788521278.221495:0:7964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199299720979ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788521278.221594:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788521278.221617:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:7962:x1875400368084352:12345-0@lo:502: 00000100:00100000:3.0:1788521278.226830:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:7962:x1875400368084352:12345-0@lo:502: Request processed in 5204us (14629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521278.226844:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788521278.227882:0:7962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:7962:1875400368084352:0@lo:502: 00000020:01000000:3.0:1788521278.227925:0:7962:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521278.227932:0:7962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521278.227935:0:7962:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788521278.227939:0:7962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788521278.231154:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788521278.231185:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788521278.231197:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.231210:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521278.231222:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788521278.231224:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0a489a19c0 from 1 10000000:01000000:2.0:1788521278.231227:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788521278.231269:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.231278:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.231289:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521278.231313:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368084992:0@lo:101: 00000100:00100000:2.0:1788521278.231398:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.231453:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.232608:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368084992 00000100:00100000:2.0:1788521278.232619:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368084992 00000100:00100000:2.0:1788521278.232691:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788521278.232703:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368084992:12345-0@lo:101: 00010000:00010000:2.0:1788521278.232719:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521278.232735:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0162d8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.232802:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.232814:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.232822:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045a00, rc 0) 00000100:00100000:2.0:1788521278.232888:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368084992:12345-0@lo:101: Request processed in 188us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.232895:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788521278.236717:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368084992:0@lo:101: 00010000:00010000:2.0:1788521278.236749:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.236763:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521278.236864:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368085120:0@lo:501: 00000100:00100000:2.0:1788521278.236928:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521278.237247:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085120 00000100:00100000:3.0:1788521278.237255:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085120 00000100:00100000:3.0:1788521278.237307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788521278.237317:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368085120:12345-0@lo:501: 00000100:00100000:3.0:1788521278.237549:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368085120:12345-0@lo:501: Request processed in 233us (620us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521278.237556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788521278.239224:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.239263:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368085120:0@lo:501: 10000000:01000000:2.0:1788521278.239308:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788521278.239320:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521278.239330:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521278.356297:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788521278.356590:0:7966:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788521278.356619:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085376:0@lo:7: 00000100:00100000:2.0:1788521278.356706:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.356757:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521278.359465:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368085248:0@lo:13: 00000100:00100000:3.0:1788521278.359538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.360477:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085248 00000100:00100000:2.0:1788521278.360489:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085248 00000100:00100000:2.0:1788521278.360560:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521278.360579:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368085248:12345-0@lo:13: 00002000:00000024:2.0:1788521278.360617:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788521278.360697:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368085248:12345-0@lo:13: Request processed in 117us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521278.360705:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788521278.360748:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1aa00 x1875400368085248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521278.360768:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368085248:0@lo:13: 00000100:00080000:3.0:1788521278.360904:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521278.363268:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085376 00000100:00100000:0.0:1788521278.363280:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085376 00000100:00100000:0.0:1788521278.363341:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521278.363350:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7966:x1875400368085376:12345-0@lo:7: 00002000:00080000:1.0:1788521278.390592:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788521278.390601:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788521278.390792:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7966:x1875400368085376:12345-0@lo:7: Request processed in 27421us (34064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.390802:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788521278.391125:0:7966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1b100 x1875400368085376/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788521294 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521278.391142:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085376:0@lo:7: 00000004:00080000:2.0:1788521278.391159:0:7966:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788521278.391202:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085504:0@lo:5: 00000100:00100000:2.0:1788521278.391240:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.391300:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.393746:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085504 00000100:00100000:1.0:1788521278.393759:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085504 00000100:00100000:1.0:1788521278.393869:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521278.393880:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7966:x1875400368085504:12345-0@lo:5: 00002000:00080000:1.0:1788521278.393911:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788521278.393915:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788521278.394623:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7966:x1875400368085504:12345-0@lo:5: Request processed in 743us (3380us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788521278.394630:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788521278.394726:0:7966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1b100 x1875400368085504/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521294 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521278.394742:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085504:0@lo:5: 00000004:00080000:3.0:1788521278.394754:0:7966:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788521278.394813:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085632:0@lo:700: 00000100:00100000:3.0:1788521278.394848:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521278.394880:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4885d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.397350:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085632 00000100:00100000:2.0:1788521278.397362:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085632 00000100:00100000:2.0:1788521278.397429:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521278.397438:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7966:x1875400368085632:12345-0@lo:700: 00000100:00100000:2.0:1788521278.397492:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1875400368085760:0@lo:700: 00000100:00100000:2.0:1788521278.397547:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521278.397593:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521278.397640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085760 00000100:00100000:1.0:1788521278.397645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085760 00000100:00100000:1.0:1788521278.397678:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521278.397694:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1875400368085760:12345-0@lo:700: 00010000:00010000:2.0:1788521278.455363:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1788521278.485089:0:5839:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788521278.494977:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1875400368085760:12345-0@lo:700: Request processed in 97285us (97422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521278.494991:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521278.495063:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c18380 x1875400368085760/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788521294 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521278.495093:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1875400368085760:0@lo:700: 40000000:02000000:1.0:1788521278.495108:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1788521278.579112:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788521278.579129:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1788521278.579253:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7966:x1875400368085632:12345-0@lo:700: Request processed in 181811us (184400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521278.579269:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521278.579319:0:7966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d1aa00 x1875400368085632/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788521294 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521278.579331:0:7966:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788521278.579346:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085632:0@lo:700: 00000001:02000400:2.0:1788521278.595364:0:7999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:02000040:3.0:1788521278.625379:0:7966:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788521278.629153:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085888:0@lo:5: 00000100:00100000:0.0:1788521278.629217:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521278.629270:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521278.629348:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368085888 00000100:00100000:2.0:1788521278.629355:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368085888 00000100:00100000:2.0:1788521278.629430:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521278.629439:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7966:x1875400368085888:12345-0@lo:5: 00002000:00080000:2.0:1788521278.650074:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788521278.650095:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788521278.657872:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7966:x1875400368085888:12345-0@lo:5: Request processed in 28426us (28646us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788521278.657885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788521278.664952:0:7966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1180 x1875400368085888/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788521294 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521278.664989:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7966:1875400368085888:0@lo:5: 00000004:00080000:3.0:1788521278.665006:0:7966:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788521279.464958:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521280.488919:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521281.515856:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521282.153160:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368086016:0@lo:13: 00000100:00100000:2.0:1788521282.153264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521282.154243:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086016 00000100:00100000:0.0:1788521282.154258:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086016 00000100:00100000:0.0:1788521282.154356:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521282.154368:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368086016:12345-0@lo:13: 00002000:00000024:0.0:1788521282.154417:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521282.154469:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521282.154504:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368086016:12345-0@lo:13: Request processed in 137us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521282.154512:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788521282.154845:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368086016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521282.154870:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368086016:0@lo:13: 00010000:00010000:2.0:1788521282.542181:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521283.560972:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521283.693284:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368086528:0@lo:400: 00000100:00100000:2.0:1788521283.693377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521283.693452:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788521283.693472:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368086144:0@lo:400: 00000100:00100000:2.0:1788521283.693507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521283.693547:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368086656:0@lo:400: 00000100:00100000:2.0:1788521283.693574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521283.693603:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368086272:0@lo:400: 00000100:00100000:2.0:1788521283.693628:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521283.693665:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368086784:0@lo:400: 00000100:00100000:0.0:1788521283.696346:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086528 00000100:00100000:0.0:1788521283.696362:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086528 00000100:00100000:0.0:1788521283.696444:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521283.696455:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368086528:12345-0@lo:400: 00000100:00100000:0.0:1788521283.696576:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368086528:12345-0@lo:400: Request processed in 122us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521283.696582:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521283.696613:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368086400:0@lo:400: 00000100:00100000:2.0:1788521283.700756:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521283.700898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086144 00000100:00100000:2.0:1788521283.700910:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086144 00000100:00100000:2.0:1788521283.700982:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521283.700994:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368086144:12345-0@lo:400: 00000100:00100000:2.0:1788521283.701081:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368086144:12345-0@lo:400: Request processed in 88us (7571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521283.701089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521283.701137:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086656 00000100:00100000:2.0:1788521283.701142:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086656 00000100:00100000:2.0:1788521283.701181:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086272 00000100:00100000:2.0:1788521283.701184:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086272 00000100:00100000:2.0:1788521283.701206:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521283.701212:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368086656:12345-0@lo:400: 00000100:00100000:2.0:1788521283.701248:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368086656:12345-0@lo:400: Request processed in 37us (7674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521283.701255:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521283.701268:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521283.701273:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368086272:12345-0@lo:400: 00000100:00100000:2.0:1788521283.701303:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368086272:12345-0@lo:400: Request processed in 30us (7675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521283.701326:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788521283.701351:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521283.701392:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368086144:0@lo:400: 00010000:00080000:2.0:1788521283.701411:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d14000 x1875400368086656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521283.701424:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368086656:0@lo:400: 00010000:00080000:2.0:1788521283.701438:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d15500 x1875400368086528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521283.701447:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368086528:0@lo:400: 00010000:00080000:2.0:1788521283.701480:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c1b100 x1875400368086272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521283.701490:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368086272:0@lo:400: 00000100:00100000:0.0:1788521283.702032:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521283.702090:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368086912:0@lo:13: 00000100:00100000:0.0:1788521283.702134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521283.702174:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086912 00000100:00100000:0.0:1788521283.702179:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086912 00000100:00100000:0.0:1788521283.702220:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521283.702229:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368086912:12345-0@lo:13: 00002000:00000024:0.0:1788521283.702268:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521283.702315:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368086912:12345-0@lo:13: Request processed in 87us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521283.702321:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788521283.702354:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368086912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521283.702372:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368086912:0@lo:13: 00000100:00100000:2.0:1788521283.703565:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086400 00000100:00100000:2.0:1788521283.703579:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086400 00000100:00100000:2.0:1788521283.703639:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521283.703660:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368086400:12345-0@lo:400: 00000100:00100000:2.0:1788521283.703941:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368086400:12345-0@lo:400: Request processed in 293us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521283.703950:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788521283.703973:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521283.703979:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788521283.704010:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75c18380 x1875400368086400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521283.704024:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368086400:0@lo:400: 00000100:00100000:1.0:1788521283.704163:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368086784 00000100:00100000:1.0:1788521283.704168:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368086784 00000100:00100000:1.0:1788521283.704202:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521283.704210:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368086784:12345-0@lo:400: 00000100:00100000:1.0:1788521283.704255:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368086784:12345-0@lo:400: Request processed in 46us (3509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521283.704261:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788521283.704407:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d14380 x1875400368086784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521283.704419:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368086784:0@lo:400: 00000001:00080000:0.0:1788521283.936613:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788521284.594553:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521285.612101:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521286.634753:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521287.273226:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521287.273740:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368087040:0@lo:13: 00000100:00100000:1.0:1788521287.273887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521287.276113:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087040 00000100:00100000:0.0:1788521287.276132:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087040 00000100:00100000:0.0:1788521287.276236:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521287.276248:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368087040:12345-0@lo:13: 00002000:00000024:0.0:1788521287.276301:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521287.276412:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368087040:12345-0@lo:13: Request processed in 167us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.276420:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788521287.276483:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f0700 x1875400368087040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521287.276520:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368087040:0@lo:13: 00000100:00080000:2.0:1788521287.276621:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521287.405834:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521287.406185:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346042752 00000100:00100000:0.0:1788521287.406205:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346042752 00000100:00100000:0.0:1788521287.406281:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:0.0:1788521287.406292:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2344:x1875400346042752:12345-192.168.203.48@tcp:250: 00010000:00080000:0.0:1788521287.406331:0:5825:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from de5f0d15-4053-4269-a3e1-52b1c2d87f1c@192.168.203.48@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1788521287.406367:0:5825:0:(genops.c:1385:class_connect()) connect: client de5f0d15-4053-4269-a3e1-52b1c2d87f1c, cookie 0x53df1cebae0162e6 00000100:00080000:0.0:1788521287.406574:0:5825:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f2b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521287.406669:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+5:2344:x1875400346042752:12345-192.168.203.48@tcp:250: Request processed in 377us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.406678:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:1.0:1788521287.415399:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.416535:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346042624 00000100:00100000:2.0:1788521287.416612:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346042624 00000100:00100000:2.0:1788521287.416913:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:2.0:1788521287.416924:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+5:5574:x1875400346042624:12345-192.168.203.48@tcp:101: 00010000:00010000:2.0:1788521287.416940:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521287.416958:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440212 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.416988:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.416999:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.417008:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea000, rc 0) 00000100:00100000:2.0:1788521287.417073:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+6:5574:x1875400346042624:12345-192.168.203.48@tcp:101: Request processed in 151us (1683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.417081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:1.0:1788521287.419257:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521287.420102:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346042880 00000100:00100000:0.0:1788521287.420113:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346042880 00000100:00100000:2.0:1788521287.420248:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:2.0:1788521287.420261:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+6:5574:x1875400346042880:12345-192.168.203.48@tcp:501: 00000100:00100000:2.0:1788521287.420662:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+6:5574:x1875400346042880:12345-192.168.203.48@tcp:501: Request processed in 397us (1405us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521287.420680:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:3.0:1788521287.425595:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521287.425849:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043008 00000100:00100000:1.0:1788521287.425858:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043008 00000100:00100000:1.0:1788521287.425897:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:1.0:1788521287.425907:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+6:5574:x1875400346043008:12345-192.168.203.48@tcp:101: 00010000:00010000:1.0:1788521287.425922:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521287.425938:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440219 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.425965:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.425976:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.425986:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166e400, rc 0) 00000100:00100000:1.0:1788521287.426042:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+7:5574:x1875400346043008:12345-192.168.203.48@tcp:101: Request processed in 135us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.426049:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:1.0:1788521287.431060:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521287.431990:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043136 00000100:00100000:0.0:1788521287.432002:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043136 00000100:00100000:0.0:1788521287.432060:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:0.0:1788521287.432071:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+7:5574:x1875400346043136:12345-192.168.203.48@tcp:501: 00000100:00100000:0.0:1788521287.432381:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5574:x1875400346043136:12345-192.168.203.48@tcp:501: Request processed in 311us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.432389:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:3.0:1788521287.436944:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.437033:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043264 00000100:00100000:2.0:1788521287.437043:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043264 00000100:00100000:2.0:1788521287.437090:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:2.0:1788521287.437099:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5574:x1875400346043264:12345-192.168.203.48@tcp:503: 00000100:00100000:2.0:1788521287.437937:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5574:x1875400346043264:12345-192.168.203.48@tcp:503: Request processed in 835us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.437946:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:3.0:1788521287.444420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521287.444967:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043392 00000100:00100000:1.0:1788521287.444977:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043392 00000100:00100000:1.0:1788521287.445032:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1788521287.445042:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5593:x1875400346043392:12345-192.168.203.48@tcp:502: 00000100:00100000:1.0:1788521287.445514:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5593:x1875400346043392:12345-192.168.203.48@tcp:502: Request processed in 463us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.445522:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1788521287.511094:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.511242:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043520 00000100:00100000:2.0:1788521287.511252:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043520 00000100:00100000:2.0:1788521287.511316:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:2.0:1788521287.511326:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5593:x1875400346043520:12345-192.168.203.48@tcp:502: 00000100:00100000:2.0:1788521287.511600:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5593:x1875400346043520:12345-192.168.203.48@tcp:502: Request processed in 275us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.511608:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:3.0:1788521287.515954:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521287.516044:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043648 00000100:00100000:1.0:1788521287.516075:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043648 00000100:00100000:1.0:1788521287.516150:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:1.0:1788521287.516162:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5574:x1875400346043648:12345-192.168.203.48@tcp:101: 00010000:00010000:1.0:1788521287.516179:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521287.516198:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166f600/0x53df1cebae0162fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440243 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.516238:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166f600/0x53df1cebae0162fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440243 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.516250:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166f600/0x53df1cebae0162fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440243 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521287.516259:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166f600, rc 0) 00000100:00100000:1.0:1788521287.516740:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5574:x1875400346043648:12345-192.168.203.48@tcp:101: Request processed in 579us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.516848:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:3.0:1788521287.536853:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521287.537353:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043776 00000100:00100000:0.0:1788521287.537369:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043776 00000100:00100000:0.0:1788521287.537439:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:0.0:1788521287.537450:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5574:x1875400346043776:12345-192.168.203.48@tcp:256: 20000000:01000000:0.0:1788521287.537478:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788521287.537501:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788521287.537514:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788521287.537518:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788521287.537520:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788521287.550582:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5574:x1875400346043776:12345-192.168.203.48@tcp:256: Request processed in 13124us (13734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.550596:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:3.0:1788521287.555897:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.556100:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346043904 00000100:00100000:2.0:1788521287.556110:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346043904 00000100:00100000:2.0:1788521287.556172:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:2.0:1788521287.556182:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5574:x1875400346043904:12345-192.168.203.48@tcp:101: 00010000:00010000:2.0:1788521287.556197:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521287.556214:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644024a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.556243:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.556438:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521287.556451:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00100000:2.0:1788521287.556561:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5574:x1875400346043904:12345-192.168.203.48@tcp:101: Request processed in 380us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.556568:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:3.0:1788521287.577158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521287.577390:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044032 00000100:00100000:0.0:1788521287.577400:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044032 00000100:00100000:0.0:1788521287.577457:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:0.0:1788521287.577467:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5574:x1875400346044032:12345-192.168.203.48@tcp:501: 00000100:00100000:0.0:1788521287.577822:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5574:x1875400346044032:12345-192.168.203.48@tcp:501: Request processed in 354us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521287.577830:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:3.0:1788521287.580258:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.581492:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044160 00000100:00100000:2.0:1788521287.581514:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044160 00000100:00100000:2.0:1788521287.581916:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:2.0:1788521287.581927:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5574:x1875400346044160:12345-192.168.203.48@tcp:503: 00000100:00100000:2.0:1788521287.582892:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5574:x1875400346044160:12345-192.168.203.48@tcp:503: Request processed in 964us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.582902:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:3.0:1788521287.593219:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521287.593412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044288 00000100:00100000:1.0:1788521287.593426:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044288 00000100:00100000:1.0:1788521287.593512:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:1.0:1788521287.593525:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5597:x1875400346044288:12345-192.168.203.48@tcp:502: 00000100:00100000:1.0:1788521287.593948:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5597:x1875400346044288:12345-192.168.203.48@tcp:502: Request processed in 424us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521287.593957:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:3.0:1788521287.597556:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.599564:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044416 00000100:00100000:2.0:1788521287.599604:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044416 00000100:00100000:2.0:1788521287.600248:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:2.0:1788521287.600263:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5597:x1875400346044416:12345-192.168.203.48@tcp:502: 00000100:00100000:2.0:1788521287.600609:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5597:x1875400346044416:12345-192.168.203.48@tcp:502: Request processed in 347us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521287.600906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:3.0:1788521287.606339:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521287.606961:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044544 00000100:00100000:2.0:1788521287.606975:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044544 00000100:00100000:2.0:1788521287.607096:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1788521287.607106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1875400346044544:12345-192.168.203.48@tcp:38: 00010000:00080000:2.0:1788521287.607165:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788521287.607226:0:5833:0:(genops.c:1385:class_connect()) connect: client 0ec78abe-db90-4086-b379-6c867e47751e, cookie 0x53df1cebae016309 00000004:00100000:2.0:1788521287.607267:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788521287.607275:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1788521287.658047:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521287.725024:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8c0a75c0d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521287.725142:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2344:x1875400346044544:12345-192.168.203.48@tcp:38: Request processed in 118033us (118815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521287.725156:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00010000:00010000:3.0:1788521288.682828:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521288.751075:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521288.751206:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044672 00000100:00100000:0.0:1788521288.751220:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044672 00000100:00100000:0.0:1788521288.751327:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1788521288.751340:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:0:x1875400346044672:12345-192.168.203.48@tcp:41: 00000100:00080000:2.0:1788521288.751414:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788521288.751424:0:6713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521288.751525:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:0:x1875400346044672:12345-192.168.203.48@tcp:41: Request processed in 188us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521288.751535:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1788521288.752374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521288.752606:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044800 00000100:00100000:2.0:1788521288.752615:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044800 00000100:00100000:2.0:1788521288.752667:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1788521288.752677:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:5574:x1875400346044800:12345-192.168.203.48@tcp:41: 00000004:00000024:2.0:1788521288.752705:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788521288.752771:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:5574:x1875400346044800:12345-192.168.203.48@tcp:41: Request processed in 95us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.752817:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1788521288.757392:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521288.757608:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346044928 00000100:00100000:0.0:1788521288.757622:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346044928 00000100:00100000:0.0:1788521288.757721:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1788521288.757734:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:5574:x1875400346044928:12345-192.168.203.48@tcp:40: 00000100:00100000:0.0:1788521288.757905:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:5574:x1875400346044928:12345-192.168.203.48@tcp:40: Request processed in 173us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521288.757913:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1788521288.765481:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521288.765561:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521288.765917:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045312 00000100:00100000:3.0:1788521288.765930:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045312 00000100:00100000:3.0:1788521288.766006:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:3.0:1788521288.766019:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346045312:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1788521288.766120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346045312:12345-192.168.203.48@tcp:400: Request processed in 103us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521288.766128:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:0.0:1788521288.770638:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045056 00000100:00100000:0.0:1788521288.770659:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045056 00000100:00100000:0.0:1788521288.770769:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1788521288.770815:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1875400346045056:12345-192.168.203.48@tcp:8: 00010000:00080000:0.0:1788521288.770855:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp t0 exp 0000000000000000 cur 209 last 0 00000100:00100000:3.0:1788521288.770964:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521288.771076:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521288.771088:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000020:00000080:0.0:1788521288.771274:0:6690:0:(genops.c:1385:class_connect()) connect: client 0ec78abe-db90-4086-b379-6c867e47751e, cookie 0x53df1cebae016310 00002000:00100000:0.0:1788521288.771291:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ec78abe-db90-4086-b379-6c867e47751e/ffff8c0a7f2b5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788521288.771304:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788521288.771837:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045184 00000100:00100000:3.0:1788521288.771847:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045184 00000100:00100000:2.0:1788521288.772006:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1788521288.772016:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875400346045184:12345-192.168.203.48@tcp:8: 00010000:00080000:2.0:1788521288.772042:0:8219:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:2.0:1788521288.772068:0:8219:0:(genops.c:1385:class_connect()) connect: client 0ec78abe-db90-4086-b379-6c867e47751e, cookie 0x53df1cebae016317 00002000:00100000:2.0:1788521288.772075:0:8219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ec78abe-db90-4086-b379-6c867e47751e/ffff8c0a7ab90000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521288.772096:0:8219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788521288.772100:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788521288.772138:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f2b7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521288.772233:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2344:x1875400346045056:12345-192.168.203.48@tcp:8: Request processed in 1420us (6770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521288.772243:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00002000:00080000:2.0:1788521288.772365:0:8219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521288.772383:0:8219:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab97800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521288.772410:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2344:x1875400346045184:12345-192.168.203.48@tcp:8: Request processed in 396us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521288.772424:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1788521288.779660:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521288.781461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045440 00000100:00100000:2.0:1788521288.781480:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045440 00000100:00100000:2.0:1788521288.781600:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1788521288.781613:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:5574:x1875400346045440:12345-192.168.203.48@tcp:33: 00000004:00080000:2.0:1788521288.812719:0:5835:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31002us 00000100:00100000:1.0:1788521288.812986:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368087552:0@lo:400: 00000100:00100000:1.0:1788521288.813085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.813167:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521288.813174:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368087168:0@lo:400: 00000100:00100000:1.0:1788521288.813207:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.813232:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368087680:0@lo:400: 00000100:00100000:1.0:1788521288.813258:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.813290:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368087296:0@lo:400: 00000100:00100000:1.0:1788521288.813314:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.813333:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368087808:0@lo:400: 00000100:00100000:1.0:1788521288.813377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.813397:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521288.813403:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368087424:0@lo:400: 00000100:00100000:1.0:1788521288.813427:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521288.813465:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087552 00000100:00100000:1.0:1788521288.813473:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087552 00000100:00100000:1.0:1788521288.813535:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087808 00000100:00100000:1.0:1788521288.813538:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087808 00000100:00100000:1.0:1788521288.813571:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521288.813594:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368087552:12345-0@lo:400: 00000100:00100000:1.0:1788521288.813667:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368087552:12345-0@lo:400: Request processed in 88us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.813675:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521288.813694:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521288.813701:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368087808:12345-0@lo:400: 00000100:00100000:1.0:1788521288.813731:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368087808:12345-0@lo:400: Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.813746:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521288.813766:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087680 00000100:00100000:1.0:1788521288.813769:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087680 00000100:00100000:1.0:1788521288.813829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087296 00000100:00100000:1.0:1788521288.813832:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087296 00000100:00100000:1.0:1788521288.813843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087424 00000100:00100000:1.0:1788521288.813845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087424 00000100:00100000:1.0:1788521288.813859:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521288.813865:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368087680:12345-0@lo:400: 00000100:00100000:1.0:1788521288.813897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368087680:12345-0@lo:400: Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.813903:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521288.813913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521288.813919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368087296:12345-0@lo:400: 00000100:00100000:1.0:1788521288.813942:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368087296:12345-0@lo:400: Request processed in 23us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.813948:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521288.813957:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521288.813963:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368087424:12345-0@lo:400: 00000100:00100000:1.0:1788521288.813987:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368087424:12345-0@lo:400: Request processed in 24us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.813992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788521288.814012:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521288.814017:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788521288.814053:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75411f80 x1875400368087424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521288.814069:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368087424:0@lo:400: 00010000:00080000:1.0:1788521288.814090:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75412680 x1875400368087296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521288.814099:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368087296:0@lo:400: 00010000:00080000:1.0:1788521288.814109:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75411c00 x1875400368087808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521288.814116:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788521288.814151:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368087808:0@lo:400: 00010000:00080000:1.0:1788521288.814178:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75413100 x1875400368087680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521288.814187:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368087680:0@lo:400: 00010000:00080000:1.0:1788521288.814198:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75410e00 x1875400368087552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521288.814207:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368087552:0@lo:400: 00000100:00100000:1.0:1788521288.814228:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087168 00000100:00100000:1.0:1788521288.814231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087168 00000100:00100000:1.0:1788521288.814262:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788521288.814269:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368087168:12345-0@lo:400: 00000100:00100000:1.0:1788521288.814305:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368087168:12345-0@lo:400: Request processed in 36us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.814311:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788521288.814348:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75410a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368087168:0@lo:400: 00000100:00100000:2.0:1788521288.814886:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368087936:0@lo:13: 00000100:00100000:2.0:1788521288.814928:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521288.815046:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368087936 00000100:00100000:0.0:1788521288.815061:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368087936 00000100:00100000:0.0:1788521288.815103:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521288.815111:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368087936:12345-0@lo:13: 00002000:00000024:0.0:1788521288.815131:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521288.832375:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368087936:12345-0@lo:13: Request processed in 17251us (17432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521288.832391:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788521288.834579:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31f800 x1875400368087936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521288.834618:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368087936:0@lo:13: 00000004:00200000:1.0:1788521288.848741:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788521288.848924:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:5574:x1875400346045440:12345-192.168.203.48@tcp:33: Request processed in 67305us (69276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521288.848960:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521289.137014:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521289.137159:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045568 00000100:00100000:1.0:1788521289.137177:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045568 00000100:00100000:1.0:1788521289.137270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:1.0:1788521289.137281:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:5615:x1875400346045568:12345-192.168.203.48@tcp:101: 00010000:00010000:1.0:1788521289.137307:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521289.138984:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f800/0x53df1cebae01631e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440274 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521289.139248:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae016325 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521289.139262:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae016325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521289.139278:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae016325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521289.139316:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521289.139320:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521289.139336:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae016325 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521289.139363:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f800/0x53df1cebae01631e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440274 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521289.139384:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae016325 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440274 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521289.139411:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1c400) 00010000:00010000:1.0:1788521289.139413:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521289.139417:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166e200, rc 0) 00000100:00100000:1.0:1788521289.139501:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:5615:x1875400346045568:12345-192.168.203.48@tcp:101: Request processed in 2213us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521289.139510:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000001:00100000:1.0:1788521289.389299:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00010000:00010000:3.0:1788521289.707602:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521290.731379:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521291.317691:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521291.317839:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045696 00000100:00100000:1.0:1788521291.317854:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045696 00000100:00100000:1.0:1788521291.317950:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1788521291.317966:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:5667:x1875400346045696:12345-192.168.203.48@tcp:41: 00000004:00000024:1.0:1788521291.318028:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788521291.318119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:5667:x1875400346045696:12345-192.168.203.48@tcp:41: Request processed in 158us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521291.318128:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00080000:2.0:1788521291.318214:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521291.322564:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521291.322867:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045824 00000100:00100000:1.0:1788521291.322881:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045824 00000100:00100000:1.0:1788521291.323035:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1788521291.323049:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec78abe-db90-4086-b379-6c867e47751e+5:5667:x1875400346045824:12345-192.168.203.48@tcp:13: 00002000:00000024:1.0:1788521291.323098:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521291.323184:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec78abe-db90-4086-b379-6c867e47751e+5:5667:x1875400346045824:12345-192.168.203.48@tcp:13: Request processed in 139us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521291.323192:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00080000:2.0:1788521291.324542:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521291.325717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521291.325846:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346045952 00000100:00100000:0.0:1788521291.325860:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346045952 00000100:00100000:0.0:1788521291.325949:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1788521291.325963:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec78abe-db90-4086-b379-6c867e47751e+6:5667:x1875400346045952:12345-192.168.203.48@tcp:13: 00002000:00000024:0.0:1788521291.326008:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788521291.326154:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521291.326248:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0ec78abe-db90-4086-b379-6c867e47751e+6:5667:x1875400346045952:12345-192.168.203.48@tcp:13: Request processed in 288us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521291.326258:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00010000:00010000:3.0:1788521291.754165:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521292.407303:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368088064:0@lo:13: 00000100:00100000:1.0:1788521292.407426:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521292.407544:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088064 00000100:00100000:1.0:1788521292.407554:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088064 00000100:00100000:1.0:1788521292.407624:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521292.407634:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368088064:12345-0@lo:13: 00002000:00000024:1.0:1788521292.407669:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521292.407721:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368088064:12345-0@lo:13: Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521292.407729:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788521292.407809:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31c700 x1875400368088064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521292.407833:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368088064:0@lo:13: 00000100:00080000:2.0:1788521292.410908:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788521292.529192:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00010000:00010000:1.0:1788521292.778742:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788521292.995613:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00010000:00010000:3.0:1788521293.801010:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521293.930825:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521293.930851:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368088192:0@lo:13: 00000100:00100000:0.0:1788521293.930916:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521293.930983:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088192 00000100:00100000:0.0:1788521293.930991:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088192 00000100:00100000:0.0:1788521293.931063:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788521293.931073:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368088192:12345-0@lo:13: 00002000:00000024:0.0:1788521293.931128:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521293.931174:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368088192:12345-0@lo:13: Request processed in 103us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521293.931181:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788521293.931224:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f0700 x1875400368088192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521293.931242:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368088192:0@lo:13: 00000100:00080000:3.0:1788521293.931740:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521293.934291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521293.934329:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521293.934372:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521293.934399:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521293.934428:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046464 00000100:00100000:3.0:1788521293.934437:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046464 00000100:00100000:3.0:1788521293.934507:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046336 00000100:00100000:3.0:1788521293.934511:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046336 00000100:00100000:3.0:1788521293.934535:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521293.935118:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346046464:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1788521293.935191:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346046464:12345-192.168.203.48@tcp:400: Request processed in 80us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521293.935198:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521293.935218:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1788521293.935224:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346046336:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1788521293.935247:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346046336:12345-192.168.203.48@tcp:400: Request processed in 23us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521293.935254:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00080000:3.0:1788521293.935377:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521293.935382:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521293.935505:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046208 00000100:00100000:0.0:1788521293.935510:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046208 00000100:00100000:0.0:1788521293.935572:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1788521293.935580:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346046208:12345-192.168.203.48@tcp:400: 00000100:00100000:0.0:1788521293.935616:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346046208:12345-192.168.203.48@tcp:400: Request processed in 37us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521293.935622:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00080000:3.0:1788521293.935799:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521293.935895:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046080 00000100:00100000:2.0:1788521293.935900:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046080 00000100:00100000:2.0:1788521293.935934:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:2.0:1788521293.935942:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2347:x1875400346046080:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1788521293.935977:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2347:x1875400346046080:12345-192.168.203.48@tcp:400: Request processed in 36us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521293.935984:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:3.0:1788521293.936351:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521293.936368:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368088576:0@lo:400: 00000100:00100000:3.0:1788521293.936410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521293.936446:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088576 00000100:00100000:3.0:1788521293.936449:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088576 00000100:00100000:3.0:1788521293.936497:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521293.936504:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368088576:12345-0@lo:400: 00000100:00100000:0.0:1788521293.937125:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368088448:0@lo:400: 00000100:00100000:0.0:1788521293.937162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521293.937185:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521293.937192:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368088320:0@lo:400: 00000100:00100000:0.0:1788521293.937221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521293.937253:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088320 00000100:00100000:0.0:1788521293.937257:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088320 00000100:00100000:0.0:1788521293.937281:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521293.937287:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368088320:12345-0@lo:400: 00000100:00100000:0.0:1788521293.937321:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368088320:12345-0@lo:400: Request processed in 35us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521293.937338:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788521293.937382:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368088320:0@lo:400: 00000100:00100000:0.0:1788521293.937408:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088448 00000100:00100000:0.0:1788521293.937412:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088448 00000100:00100000:0.0:1788521293.937435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521293.937441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368088448:12345-0@lo:400: 00000100:00100000:0.0:1788521293.937489:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368088448:12345-0@lo:400: Request processed in 48us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521293.937495:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521293.937526:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368088448:0@lo:400: 00000100:00080000:0.0:1788521293.938324:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521293.938386:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521293.938397:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368088832:0@lo:400: 00000100:00100000:0.0:1788521293.938434:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521293.938476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088832 00000100:00100000:0.0:1788521293.938481:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088832 00000100:00100000:0.0:1788521293.938523:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521293.938530:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368088832:12345-0@lo:400: 00000100:00100000:0.0:1788521293.938583:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368088832:12345-0@lo:400: Request processed in 53us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521293.938595:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788521293.938614:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521293.938647:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368088832:0@lo:400: 00000100:00100000:3.0:1788521293.939361:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368088576:12345-0@lo:400: Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521293.939378:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521293.939413:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368088704:0@lo:400: 00000100:00100000:3.0:1788521293.939469:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521293.939507:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368088576:0@lo:400: 00000100:00100000:3.0:1788521293.939535:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088704 00000100:00100000:3.0:1788521293.940705:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088704 00000100:00100000:3.0:1788521293.940837:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788521293.940847:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368088704:12345-0@lo:400: 00000100:00100000:3.0:1788521293.940919:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368088704:12345-0@lo:400: Request processed in 74us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521293.940926:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788521293.941008:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f2d80 x1875400368088704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521293.941037:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368088704:0@lo:400: 00000001:02000400:0.0:1788521294.290656:0:8308:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788521294.826501:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521295.852227:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521296.878692:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521297.513354:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368088960:0@lo:13: 00000100:00100000:1.0:1788521297.513468:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521297.513997:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368088960 00000100:00100000:0.0:1788521297.514006:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368088960 00000100:00100000:0.0:1788521297.514092:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521297.514105:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368088960:12345-0@lo:13: 00002000:00000024:0.0:1788521297.514146:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788521297.514151:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521297.514214:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368088960:12345-0@lo:13: Request processed in 109us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521297.514224:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788521297.514276:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f2d80 x1875400368088960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521297.514302:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368088960:0@lo:13: 00010000:00010000:3.0:1788521297.901045:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788521298.569013:0:8458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec9fb42f0 20000000:00000080:2.0:1788521298.569041:0:8458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c0a818f5000 uarg=0000000000000000 20000000:01000000:2.0:1788521298.569092:0:8458:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788521298.569095:0:8458:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788521298.569099:0:8458:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788521298.569105:0:8458:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788521298.569111:0:8458:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788521298.569137:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788521298.569140:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788521298.569383:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788521298.569387:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521298.571275:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788521298.571900:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788521298.571974:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788521298.572005:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788521298.572021:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788521298.572024:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788521298.573190:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788521298.573768:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788521298.574635:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788521298.574708:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788521298.574727:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788521298.574730:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788521298.582045:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788521298.582767:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788521298.582883:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788521298.582922:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788521298.582935:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788521298.582938:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788521298.586100:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788521298.587258:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788521298.587528:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788521298.587558:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1788521298.587574:0:8458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788521298.587597:0:8458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587620:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016222 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587629:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01624c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587637:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016276 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587643:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016284 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587651:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016292 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587658:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0162ae expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587672:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587684:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587691:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587699:0:8458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587746:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.587765:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 9 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521298.587991:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089088:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521298.594510:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594551:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521298.594571:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089216:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521298.594616:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594625:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 18 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521298.594634:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089344:0@lo:104: 00000100:00100000:3.0:1788521298.594681:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521298.594721:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0162ae expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.594729:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0162ae expref: 18 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521298.594737:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089472:0@lo:104: 00000100:00100000:3.0:1788521298.594761:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521298.595135:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788521298.595153:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368089344 00000100:00100000:2.0:1788521298.595162:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368089344 00000100:00100000:2.0:1788521298.595205:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368089472 00000100:00100000:2.0:1788521298.595207:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368089472 00000100:00100000:2.0:1788521298.595221:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521298.595231:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:8458:x1875400368089344:12345-0@lo:104: 00010000:00010000:2.0:1788521298.595248:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.595485:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521298.595493:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:8458:x1875400368089344:12345-0@lo:104: Request processed in 263us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521298.595501:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521298.595521:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521298.595526:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:8458:x1875400368089472:12345-0@lo:104: 00010000:00010000:2.0:1788521298.595534:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599496:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521298.599519:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599534:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82045600 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521298.599539:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599551:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521298.599559:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521298.599594:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521298.599671:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599679:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521298.599704:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599712:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae0162d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0162df expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599735:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521298.599738:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599745:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521298.599748:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599755:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521298.599761:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521298.599766:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521298.599800:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599806:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521298.599818:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599824:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4200/0x53df1cebae0162ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0162b5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.599834:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521298.599836:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521298.599838:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521298.599886:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368089600:0@lo:103: 00000100:00100000:0.0:1788521298.599976:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521298.600043:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521298.600050:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368089728:0@lo:103: 00000100:00100000:0.0:1788521298.600073:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521298.600112:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368089600 00000100:00100000:0.0:1788521298.600123:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368089600 00010000:00010000:0.0:1788521298.600165:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 19 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.600196:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368089728 00000100:00100000:0.0:1788521298.600199:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368089728 00010000:00010000:0.0:1788521298.600212:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0162ae expref: 20 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.600227:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521298.600235:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3302:x1875400368089600:12345-0@lo:103: 00010000:00010000:0.0:1788521298.600250:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.600255:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 20 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.600277:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 20 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.600405:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.600456:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3302:x1875400368089600:12345-0@lo:103: Request processed in 221us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.600464:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521298.600483:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521298.600490:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368089728:12345-0@lo:103: 00010000:00010000:0.0:1788521298.600499:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.600503:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0162ae expref: 19 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.600511:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0162ae expref: 19 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.600522:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.600547:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368089728:12345-0@lo:103: Request processed in 58us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.600553:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521298.600601:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368089728:0@lo:103: 00000100:00100000:0.0:1788521298.600612:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368089600:0@lo:103: 00010000:00010000:0.0:1788521298.600960:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016292 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.600975:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016292 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.601000:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089856:0@lo:104: 00000100:00100000:0.0:1788521298.601034:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521298.601067:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016284 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.601076:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016284 expref: 18 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.601084:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089984:0@lo:104: 00000100:00100000:0.0:1788521298.601103:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521298.601118:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016276 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.601124:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016276 expref: 18 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.601132:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368090112:0@lo:104: 00000100:00100000:0.0:1788521298.601149:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521298.601164:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae01624c expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.601171:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae01624c expref: 18 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.601177:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368090240:0@lo:104: 00000100:00100000:0.0:1788521298.601194:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788521298.601208:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016222 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.601226:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016222 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.601233:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368090368:0@lo:104: 00000100:00100000:0.0:1788521298.601254:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521298.601265:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1788521298.601720:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788521298.601733:0:5817:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788521298.602460:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82045a00/0x53df1cebae0162df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0162d8 expref: 18 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.602483:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089344:0@lo:104: 00010000:00010000:0.0:1788521298.602510:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c5600/0x53df1cebae0162b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0162ae expref: 17 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.602519:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089472:0@lo:104: 00000100:00100000:3.0:1788521298.602684:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368089856 00000100:00100000:3.0:1788521298.602693:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368089856 00000100:00100000:3.0:1788521298.602743:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788521298.602752:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368089984 00000100:00100000:3.0:1788521298.602755:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368089984 00000100:00100000:3.0:1788521298.602766:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788521298.602793:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090112 00000100:00100000:3.0:1788521298.602796:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090112 00000100:00100000:3.0:1788521298.602808:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788521298.602827:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090240 00000100:00100000:3.0:1788521298.602830:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090240 00000100:00100000:3.0:1788521298.602844:0:5817:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788521298.602849:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090368 00000100:00100000:3.0:1788521298.602851:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090368 00000100:00100000:0.0:1788521298.603065:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521298.603109:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046592 00000100:00100000:0.0:1788521298.603112:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046592 00010000:00010000:0.0:1788521298.603143:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 10 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.603169:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521298.603179:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2346:x1875400346046592:12345-192.168.203.48@tcp:103: 00010000:00010000:0.0:1788521298.603195:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.603201:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 10 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.603214:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 10 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.603244:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521298.603448:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521298.603458:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+8:8458:x1875400368089856:12345-0@lo:104: 00010000:00010000:1.0:1788521298.603471:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.603523:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521298.603530:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+8:8458:x1875400368089856:12345-0@lo:104: Request processed in 75us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.603544:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521298.603565:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521298.603572:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+7:8458:x1875400368089984:12345-0@lo:104: 00010000:00010000:1.0:1788521298.603581:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.603615:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521298.603621:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+7:8458:x1875400368089984:12345-0@lo:104: Request processed in 51us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.603626:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521298.603638:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521298.603645:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:8458:x1875400368090112:12345-0@lo:104: 00010000:00010000:1.0:1788521298.603652:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.603678:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788521298.603683:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+6:8458:x1875400368090112:12345-0@lo:104: Request processed in 39us (2534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.603688:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521298.603698:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521298.603704:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:8458:x1875400368090240:12345-0@lo:104: 00010000:00010000:1.0:1788521298.603711:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.603737:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788521298.603742:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:8458:x1875400368090240:12345-0@lo:104: Request processed in 38us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.603752:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521298.603764:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521298.603804:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:8458:x1875400368090368:12345-0@lo:104: 00010000:00010000:1.0:1788521298.603814:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.603843:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788521298.603847:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:8458:x1875400368090368:12345-0@lo:104: Request processed in 79us (2593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.603853:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788521298.603976:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788521298.603984:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.603992:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82044e00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521298.603997:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604005:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521298.604014:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521298.604019:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521298.604071:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604078:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521298.604102:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604109:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a82044e00/0x53df1cebae016292 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016299 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604124:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788521298.604127:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604141:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f000 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521298.604144:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604151:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521298.604157:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521298.604162:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521298.604177:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604183:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521298.604189:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604195:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f000/0x53df1cebae016284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01628b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604205:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521298.604209:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604215:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4000 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521298.604218:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604236:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521298.604242:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521298.604248:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521298.604263:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604269:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521298.604375:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604383:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4000/0x53df1cebae016276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01627d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604395:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521298.604398:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604404:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82044200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521298.604407:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604414:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521298.604420:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521298.604442:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521298.604456:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604464:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521298.604469:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604476:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a82044200/0x53df1cebae01624c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016253 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604486:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521298.604489:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604494:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0e00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521298.604497:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604504:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521298.604509:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521298.604514:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788521298.604525:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604529:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521298.604541:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604547:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae016222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016229 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521298.604562:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521298.604564:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521298.604566:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521298.604708:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368090496:0@lo:103: 00000100:00100000:3.0:1788521298.604762:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521298.604881:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368091008:0@lo:103: 00000100:00100000:3.0:1788521298.604903:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521298.604919:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521298.604924:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368090624:0@lo:103: 00000100:00100000:3.0:1788521298.604944:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521298.604996:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae0162f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440219 expref: 10 pid: 5826 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521298.605011:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089088:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521298.605023:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089216:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521298.605037:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089856:0@lo:104: 00000100:00100000:3.0:1788521298.605045:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368089984:0@lo:104: 00000100:00100000:3.0:1788521298.605054:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368090112:0@lo:104: 00000100:00100000:3.0:1788521298.605063:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368090240:0@lo:104: 00000100:00100000:3.0:1788521298.605071:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875400368090368:0@lo:104: 00010000:00010000:3.0:1788521298.605117:0:8458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.605240:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:2346:x1875400346046592:12345-192.168.203.48@tcp:103: Request processed in 2060us (2176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.605252:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521298.605279:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090496 00000100:00100000:0.0:1788521298.605413:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090496 00010000:00010000:0.0:1788521298.605451:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016292 expref: 17 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.605470:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091008 00000100:00100000:0.0:1788521298.605474:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091008 00010000:00010000:0.0:1788521298.605485:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016222 expref: 18 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.605494:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090624 00000100:00100000:0.0:1788521298.605496:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090624 00010000:00010000:0.0:1788521298.605505:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016284 expref: 19 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.605518:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521298.605525:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368090496:12345-0@lo:103: 00010000:00010000:0.0:1788521298.605537:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.605543:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016292 expref: 19 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605555:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016292 expref: 19 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605572:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0200/0x53df1cebae016299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016292 expref: 19 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605595:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.605643:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3300:x1875400368090496:12345-0@lo:103: Request processed in 119us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.605649:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521298.605662:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521298.605667:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3300:x1875400368091008:12345-0@lo:103: 00010000:00010000:0.0:1788521298.605674:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.605678:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016222 expref: 17 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605686:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016222 expref: 17 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605695:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae016229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016222 expref: 17 pid: 5826 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605705:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.605727:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3300:x1875400368091008:12345-0@lo:103: Request processed in 60us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.605733:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521298.605744:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521298.605750:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:3300:x1875400368090624:12345-0@lo:103: 00010000:00010000:0.0:1788521298.605758:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.605762:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016284 expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605770:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016284 expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605810:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c5800/0x53df1cebae01628b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016284 expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.605820:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.605843:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3300:x1875400368090624:12345-0@lo:103: Request processed in 94us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.605849:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788521298.605875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521298.605893:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368090752:0@lo:103: 00000100:00100000:0.0:1788521298.605927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521298.605958:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521298.605964:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368090880:0@lo:103: 00000100:00100000:0.0:1788521298.605984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521298.606011:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090752 00000100:00100000:0.0:1788521298.606014:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090752 00010000:00010000:0.0:1788521298.606028:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016276 expref: 14 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.606042:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368090880 00000100:00100000:0.0:1788521298.606044:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368090880 00010000:00010000:0.0:1788521298.606053:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01624c expref: 15 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521298.606064:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521298.606070:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:3302:x1875400368090752:12345-0@lo:103: 00010000:00010000:0.0:1788521298.606077:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.606081:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016276 expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.606101:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016276 expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.606111:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166e600/0x53df1cebae01627d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016276 expref: 15 pid: 5825 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.606119:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.606144:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46424c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3302:x1875400368090752:12345-0@lo:103: Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.606150:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521298.606191:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788521298.606197:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:3302:x1875400368090880:12345-0@lo:103: 00010000:00010000:0.0:1788521298.606204:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521298.606208:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01624c expref: 13 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.606216:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae01624c expref: 13 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.606225:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae01624c expref: 13 pid: 5828 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521298.606233:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521298.606254:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3302:x1875400368090880:12345-0@lo:103: Request processed in 57us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521298.606260:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788521298.606523:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788521298.606534:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:8458:x1875400368089472:12345-0@lo:104: Request processed in 11005us (11770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521298.606542:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521298.606636:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1788521298.606895:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521298.607885:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046720 00000100:00100000:1.0:1788521298.607899:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046720 00010000:00010000:1.0:1788521298.607947:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521298.607978:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521298.607987:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:2345:x1875400346046720:12345-192.168.203.48@tcp:103: 00010000:00010000:1.0:1788521298.608003:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521298.608009:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608022:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608040:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea000/0x53df1cebae0162ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440212 expref: 9 pid: 5828 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608081:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608090:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608109:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608118:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608126:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608133:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608141:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521298.608146:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608155:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608174:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521298.608188:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521298.608257:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:2345:x1875400346046720:12345-192.168.203.48@tcp:103: Request processed in 271us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521298.608270:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00010000:00010000:2.0:1788521298.608702:0:8458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.608711:0:8458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521298.608718:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea800/0x53df1cebae01632c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521298.612895:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368090880:0@lo:103: 00000100:00100000:2.0:1788521298.612915:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368090752:0@lo:103: 00000100:00100000:0.0:1788521298.616505:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368090624:0@lo:103: 00000100:00100000:0.0:1788521298.616583:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368090496:0@lo:103: 00000100:00100000:0.0:1788521298.616620:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368091008:0@lo:103: 00010000:00010000:2.0:1788521298.933938:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521299.049032:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368091136:0@lo:13: 00000100:00100000:1.0:1788521299.049111:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521299.049349:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368091520:0@lo:400: 00000100:00100000:2.0:1788521299.049439:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521299.049477:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521299.049484:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368091648:0@lo:400: 00000100:00100000:2.0:1788521299.049515:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521299.049550:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091648 00000100:00100000:2.0:1788521299.049561:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091648 00000100:00100000:2.0:1788521299.049630:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521299.049646:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368091648:12345-0@lo:400: 00000100:00100000:1.0:1788521299.049800:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368091392:0@lo:400: 00000100:00100000:1.0:1788521299.049831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521299.049851:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788521299.049856:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368091264:0@lo:400: 00000100:00100000:1.0:1788521299.049898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521299.049922:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368091776:0@lo:400: 00000100:00100000:1.0:1788521299.049944:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521299.049987:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521299.050223:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091520 00000100:00100000:3.0:1788521299.050229:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091520 00000100:00100000:3.0:1788521299.050276:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091392 00000100:00100000:3.0:1788521299.050279:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091392 00000100:00100000:3.0:1788521299.050293:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091776 00000100:00100000:3.0:1788521299.050296:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091776 00000100:00100000:3.0:1788521299.050312:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521299.050320:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368091520:12345-0@lo:400: 00000100:00100000:3.0:1788521299.050374:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368091520:12345-0@lo:400: Request processed in 55us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521299.050382:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521299.050414:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521299.050421:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368091392:12345-0@lo:400: 00000100:00100000:3.0:1788521299.050464:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368091392:12345-0@lo:400: Request processed in 44us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521299.050470:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521299.050481:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521299.050487:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368091776:12345-0@lo:400: 00000100:00100000:3.0:1788521299.050512:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368091776:12345-0@lo:400: Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521299.050517:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521299.050561:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368091776:0@lo:400: 00000100:00100000:3.0:1788521299.050573:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368091392:0@lo:400: 00000100:00100000:2.0:1788521299.050938:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368091648:12345-0@lo:400: Request processed in 1294us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521299.050947:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788521299.051004:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d15c00 x1875400368091648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521299.051016:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368091648:0@lo:400: 00000100:00100000:2.0:1788521299.051027:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368091520:0@lo:400: 00000100:00080000:1.0:1788521299.051101:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521299.051525:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091136 00000100:00100000:0.0:1788521299.051533:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091136 00000100:00100000:0.0:1788521299.051587:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521299.051596:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368091136:12345-0@lo:13: 00002000:00000024:0.0:1788521299.051636:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788521299.051795:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788521299.051875:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f3b80 x1875400368091136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521299.051919:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368091136:0@lo:13: 00000100:00100000:0.0:1788521299.052064:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368091136:12345-0@lo:13: Request processed in 469us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521299.052073:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788521299.052109:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091264 00000100:00100000:0.0:1788521299.052113:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091264 00000100:00100000:0.0:1788521299.052147:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788521299.052154:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3303:x1875400368091264:12345-0@lo:400: 00000100:00100000:0.0:1788521299.052200:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:3303:x1875400368091264:12345-0@lo:400: Request processed in 47us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521299.052207:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788521299.053010:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368091264:0@lo:400: 00000100:00100000:2.0:1788521299.059978:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521299.060039:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521299.060087:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521299.060264:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046976 00000100:00100000:1.0:1788521299.060277:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046976 00000100:00100000:1.0:1788521299.060380:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047104 00000100:00100000:1.0:1788521299.060384:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047104 00000100:00100000:3.0:1788521299.060439:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00080000:2.0:1788521299.060464:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521299.060473:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346046976:12345-192.168.203.48@tcp:400: 00000100:00080000:2.0:1788521299.060474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521299.060595:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346046976:12345-192.168.203.48@tcp:400: Request processed in 141us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521299.061336:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346046848 00000100:00100000:0.0:1788521299.061346:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346046848 00000100:00100000:0.0:1788521299.061412:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:0.0:1788521299.061422:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346046848:12345-192.168.203.48@tcp:400: 00000100:00080000:2.0:1788521299.061502:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521299.061517:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346046848:12345-192.168.203.48@tcp:400: Request processed in 96us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521299.061527:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:1.0:1788521299.065360:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1788521299.065469:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346047104:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1788521299.066038:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346047104:12345-192.168.203.48@tcp:400: Request processed in 655us (5946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521299.066364:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1788521299.078845:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1788521299.698382:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521299.698499:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047232 00000100:00100000:0.0:1788521299.698510:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047232 00000100:00100000:0.0:1788521299.698567:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:0.0:1788521299.698593:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:5589:x1875400346047232:12345-192.168.203.48@tcp:101: 00010000:00010000:0.0:1788521299.698611:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521299.698629:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c5600/0x53df1cebae016333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644027b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521299.698657:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c5600/0x53df1cebae016333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644027b expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521299.698669:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c5600/0x53df1cebae016333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644027b expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521299.698678:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5600, rc 0) 00000100:00100000:0.0:1788521299.698740:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346047232:12345-192.168.203.48@tcp:101: Request processed in 148us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521299.698747:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:0.0:1788521299.707635:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521299.711976:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047360 00000100:00100000:1.0:1788521299.711990:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047360 00000100:00100000:1.0:1788521299.712059:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:1.0:1788521299.712068:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346047360:12345-192.168.203.48@tcp:501: 00000100:00100000:1.0:1788521299.712428:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346047360:12345-192.168.203.48@tcp:501: Request processed in 351us (4793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521299.712436:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:1.0:1788521299.719944:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521299.724719:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047488 00000100:00100000:2.0:1788521299.724733:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047488 00000100:00100000:2.0:1788521299.724825:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:2.0:1788521299.724835:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346047488:12345-192.168.203.48@tcp:503: 00000100:00100000:2.0:1788521299.725060:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346047488:12345-192.168.203.48@tcp:503: Request processed in 226us (5127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521299.725068:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:2.0:1788521299.733883:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521299.736018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047616 00000100:00100000:0.0:1788521299.736034:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047616 00000100:00100000:0.0:1788521299.736105:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:0.0:1788521299.736116:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:6055:x1875400346047616:12345-192.168.203.48@tcp:502: 00000100:00100000:0.0:1788521299.736414:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:6055:x1875400346047616:12345-192.168.203.48@tcp:502: Request processed in 299us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521299.736431:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:0.0:1788521299.745034:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521299.745138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047744 00000100:00100000:1.0:1788521299.745149:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047744 00000100:00100000:1.0:1788521299.745200:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:1.0:1788521299.745210:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:6055:x1875400346047744:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521299.745494:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:6055:x1875400346047744:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 283us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521299.745502:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:1.0:1788521299.758917:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521299.759015:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346047872 00000100:00100000:2.0:1788521299.759028:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346047872 00000100:00100000:2.0:1788521299.759092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:2.0:1788521299.759102:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346047872:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521299.759119:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521299.759137:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81beaa00/0x53df1cebae01633a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440282 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521299.759166:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beaa00/0x53df1cebae01633a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440282 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521299.759177:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81beaa00/0x53df1cebae01633a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440282 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521299.759186:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beaa00, rc 0) 00000100:00100000:2.0:1788521299.759252:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346047872:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 151us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521299.759259:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:2.0:1788521299.769333:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521299.769439:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048000 00000100:00100000:0.0:1788521299.769450:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048000 00000100:00100000:0.0:1788521299.769506:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:0.0:1788521299.769517:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048000:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521299.769818:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048000:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 302us (494us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521299.769826:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 138 00010000:00010000:1.0:1788521299.945700:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521300.456828:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788521300.456835:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a7f66c000 from 39 10000000:01000000:1.0:1788521300.456840:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521300.456882:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.456893:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.456906:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521300.456927:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368091904:0@lo:101: 00000100:00100000:1.0:1788521300.456995:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521300.457049:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0941fc2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.460667:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368091904 00000100:00100000:2.0:1788521300.460683:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368091904 00000100:00100000:2.0:1788521300.460761:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788521300.460787:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+12:5830:x1875400368091904:12345-0@lo:101: 00010000:00010000:2.0:1788521300.460821:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521300.460840:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea800/0x53df1cebae016348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016341 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.460869:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea800/0x53df1cebae016348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016341 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.460894:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bea800/0x53df1cebae016348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016341 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.460904:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea800, rc 0) 00000100:00100000:2.0:1788521300.460978:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368091904:12345-0@lo:101: Request processed in 207us (3981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.460985:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788521300.462649:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368091904:0@lo:101: 00010000:00010000:3.0:1788521300.462675:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.462688:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.462766:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092032:0@lo:501: 00000100:00100000:3.0:1788521300.462843:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.462891:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521300.463046:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092032 00000100:00100000:1.0:1788521300.463052:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092032 00000100:00100000:1.0:1788521300.463086:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788521300.463094:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368092032:12345-0@lo:501: 00000100:00100000:1.0:1788521300.463340:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368092032:12345-0@lo:501: Request processed in 246us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521300.463349:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788521300.464297:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092032:0@lo:501: 00000100:00100000:3.0:1788521300.464344:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092160:0@lo:503: 00000100:00100000:3.0:1788521300.464407:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.464445:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.464461:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092160 00000100:00100000:3.0:1788521300.464465:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092160 00000100:00100000:3.0:1788521300.464497:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788521300.464510:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368092160:12345-0@lo:503: 00000100:00100000:3.0:1788521300.464672:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368092160:12345-0@lo:503: Request processed in 162us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.464679:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788521300.464720:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092160:0@lo:503: 00000100:00100000:3.0:1788521300.464920:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8493:1875400368092288:0@lo:502: 00000100:00100000:3.0:1788521300.464949:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.464965:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092288 00000100:00100000:3.0:1788521300.464968:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092288 00000100:00100000:3.0:1788521300.464984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521300.464989:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:8493:x1875400368092288:12345-0@lo:502: 00000100:00100000:3.0:1788521300.465115:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:8493:x1875400368092288:12345-0@lo:502: Request processed in 125us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.465121:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788521300.465143:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.465153:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8493:1875400368092288:0@lo:502: 00000100:00100000:3.0:1788521300.465182:0:8493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8493:1875400368092416:0@lo:502: 00000100:00100000:3.0:1788521300.465206:0:8493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.465220:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092416 00000100:00100000:3.0:1788521300.465223:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092416 00000100:00100000:3.0:1788521300.465238:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788521300.465243:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:8493:x1875400368092416:12345-0@lo:502: 00000100:00100000:3.0:1788521300.465346:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:8493:x1875400368092416:12345-0@lo:502: Request processed in 101us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.465352:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788521300.465380:0:8493:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.465391:0:8493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8493:1875400368092416:0@lo:502: 00000040:00080000:3.0:1788521300.465407:0:8493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788521300.465464:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788521300.465481:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521300.465489:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465499:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521300.465508:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788521300.465510:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788521300.465513:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521300.465534:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465541:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465550:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.465560:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092544:0@lo:101: 00000100:00100000:3.0:1788521300.465583:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.465594:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.465604:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092544 00000100:00100000:3.0:1788521300.465607:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092544 00000100:00100000:3.0:1788521300.465624:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788521300.465629:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+13:5830:x1875400368092544:12345-0@lo:101: 00010000:00010000:3.0:1788521300.465642:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521300.465653:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1600/0x53df1cebae016356 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01634f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465674:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1600/0x53df1cebae016356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01634f expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465684:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a1600/0x53df1cebae016356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01634f expref: 14 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465691:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1600, rc 0) 00000100:00100000:3.0:1788521300.465717:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368092544:12345-0@lo:101: Request processed in 87us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.465722:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788521300.465748:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092544:0@lo:101: 00010000:00010000:3.0:1788521300.465757:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.465765:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.465813:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092672:0@lo:501: 00000100:00100000:3.0:1788521300.465835:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.465846:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.465856:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092672 00000100:00100000:3.0:1788521300.465859:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092672 00000100:00100000:3.0:1788521300.465878:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788521300.465883:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368092672:12345-0@lo:501: 00000100:00100000:3.0:1788521300.466086:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368092672:12345-0@lo:501: Request processed in 201us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.466092:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788521300.466118:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092672:0@lo:501: 00000100:00100000:3.0:1788521300.466141:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092800:0@lo:503: 00000100:00100000:3.0:1788521300.466170:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.466183:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.466194:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092800 00000100:00100000:3.0:1788521300.466197:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092800 00000100:00100000:3.0:1788521300.466215:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788521300.466221:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368092800:12345-0@lo:503: 00000100:00100000:3.0:1788521300.466350:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368092800:12345-0@lo:503: Request processed in 129us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.466362:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788521300.466398:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368092800:0@lo:503: 00000100:00100000:3.0:1788521300.466590:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8494:1875400368092928:0@lo:502: 00000100:00100000:3.0:1788521300.466623:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.466641:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368092928 00000100:00100000:3.0:1788521300.466644:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368092928 00000100:00100000:3.0:1788521300.466664:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788521300.466669:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:8494:x1875400368092928:12345-0@lo:502: 00000100:00100000:3.0:1788521300.466797:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:8494:x1875400368092928:12345-0@lo:502: Request processed in 127us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.466803:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788521300.466830:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.466846:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8494:1875400368092928:0@lo:502: 00000020:01000000:3.0:1788521300.466864:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521300.466871:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521300.466873:0:8494:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788521300.466878:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788521300.466896:0:8494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8494:1875400368093056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.466923:0:8494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.466941:0:8494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521300.466948:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093056 00000100:00100000:0.0:1788521300.466953:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093056 00000100:00100000:0.0:1788521300.466984:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788521300.466990:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:8494:x1875400368093056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.467100:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:8494:x1875400368093056:12345-0@lo:502:llog_process_th.0 Request processed in 109us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.467107:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788521300.467493:0:8494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8494:1875400368093056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521300.467514:0:8494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521300.467518:0:8494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521300.467520:0:8494:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788521300.467524:0:8494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788521300.467564:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788521300.467583:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788521300.467722:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.467732:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521300.467742:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521300.467745:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a75d22000 from 39 10000000:01000000:3.0:1788521300.467748:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521300.467770:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.467961:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.467978:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.467993:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.468028:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.468096:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.468130:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093184 00000100:00100000:2.0:1788521300.468136:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093184 00000100:00100000:2.0:1788521300.468169:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788521300.468177:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:5830:x1875400368093184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521300.468187:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521300.468204:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea000/0x53df1cebae016364 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01635d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.468225:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea000/0x53df1cebae016364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01635d expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.468234:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bea000/0x53df1cebae016364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01635d expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.468242:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea000, rc 0) 00000100:00100000:2.0:1788521300.468319:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368093184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.468326:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788521300.468380:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521300.468391:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.468473:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.468518:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.468544:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.468809:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.468855:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093312 00000100:00100000:2.0:1788521300.468860:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093312 00000100:00100000:2.0:1788521300.468959:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788521300.468967:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368093312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.469254:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368093312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.469261:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788521300.469311:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.469344:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.469378:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.469497:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.469526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093440 00000100:00100000:2.0:1788521300.469530:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093440 00000100:00100000:2.0:1788521300.469557:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788521300.469563:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368093440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.469849:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368093440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.469855:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788521300.469986:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.470259:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8496:1875400368093568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521300.470289:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.470347:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.470375:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093568 00000100:00100000:3.0:1788521300.470380:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093568 00000100:00100000:3.0:1788521300.470506:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788521300.470514:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:8496:x1875400368093568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.470798:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:8496:x1875400368093568:12345-0@lo:502:llog_process_th.0 Request processed in 284us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.470806:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788521300.470898:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8496:1875400368093568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.470938:0:8496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8496:1875400368093696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.470972:0:8496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.471174:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093696 00000100:00100000:2.0:1788521300.471178:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093696 00000100:00100000:2.0:1788521300.471199:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521300.471205:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:8496:x1875400368093696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521300.471339:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:8496:x1875400368093696:12345-0@lo:502:llog_process_th.0 Request processed in 132us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.471354:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788521300.471529:0:8496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7e840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521300.471545:0:8496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8496:1875400368093696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788521300.471570:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788521300.471973:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788521300.471995:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521300.472005:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.472016:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521300.472025:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788521300.472028:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788521300.472031:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521300.472056:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.472064:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.472074:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.472089:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.472122:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.472151:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521300.472204:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093824 00000100:00100000:0.0:1788521300.472209:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093824 00000100:00100000:0.0:1788521300.472241:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788521300.472248:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:5830:x1875400368093824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521300.472257:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521300.472268:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01636b expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.472288:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01636b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.472304:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01636b expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.472313:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4600, rc 0) 00000100:00100000:0.0:1788521300.472356:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368093824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.472362:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788521300.472561:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521300.472574:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.472645:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.472693:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.472715:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.472734:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521300.472769:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368093952 00000100:00100000:0.0:1788521300.472835:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368093952 00000100:00100000:3.0:1788521300.474517:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788521300.474530:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368093952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.474863:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368093952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.474871:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788521300.474979:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368093952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.475046:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.475086:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.475118:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.475153:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094080 00000100:00100000:3.0:1788521300.475159:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094080 00000100:00100000:3.0:1788521300.475182:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788521300.475189:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368094080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.475438:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368094080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.475445:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788521300.475501:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.476025:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8497:1875400368094208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.476062:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.476101:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.476144:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094208 00000100:00100000:3.0:1788521300.476149:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094208 00000100:00100000:3.0:1788521300.476177:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788521300.476183:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:8497:x1875400368094208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.476370:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:8497:x1875400368094208:12345-0@lo:502:llog_process_th.0 Request processed in 186us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.476376:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788521300.476685:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8497:1875400368094208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521300.476711:0:8497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521300.476721:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521300.476723:0:8497:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788521300.476728:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788521300.476750:0:8497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8497:1875400368094336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521300.476816:0:8497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521300.476979:0:8497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0941fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.477173:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094336 00000100:00100000:3.0:1788521300.477179:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094336 00000100:00100000:3.0:1788521300.477210:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788521300.477218:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:8497:x1875400368094336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.477367:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:8497:x1875400368094336:12345-0@lo:502:llog_process_th.0 Request processed in 149us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.477374:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788521300.477500:0:8497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8497:1875400368094336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521300.477519:0:8497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521300.477524:0:8497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521300.477526:0:8497:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521300.477539:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788521300.477965:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788521300.477986:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788521300.477996:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.478007:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521300.478016:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788521300.478018:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a4f90d800 from 39 10000000:01000000:3.0:1788521300.478021:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788521300.478048:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.478056:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.478065:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.478655:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.478705:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.478752:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f265a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.478846:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094464 00000100:00100000:2.0:1788521300.478852:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094464 00000100:00100000:2.0:1788521300.478883:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788521300.478892:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368094464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521300.478903:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521300.478915:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bebe00/0x53df1cebae016380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016379 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.478938:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bebe00/0x53df1cebae016380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016379 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.478947:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bebe00/0x53df1cebae016380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016379 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.478955:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bebe00, rc 0) 00000100:00100000:2.0:1788521300.478995:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368094464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.479001:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788521300.479453:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521300.479468:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.479478:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521300.479538:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.479570:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.479599:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.479642:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094592 00000100:00100000:2.0:1788521300.479647:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094592 00000100:00100000:2.0:1788521300.479678:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788521300.479686:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368094592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.479957:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368094592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.479965:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788521300.480216:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.480250:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.480368:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.480387:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.480443:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094720 00000100:00100000:3.0:1788521300.480448:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094720 00000100:00100000:3.0:1788521300.480479:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788521300.480487:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368094720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.480643:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368094720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.480650:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788521300.480725:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368094720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.481217:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8498:1875400368094848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.481253:0:8498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.481364:0:8498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.481391:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094848 00000100:00100000:3.0:1788521300.481395:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094848 00000100:00100000:3.0:1788521300.481455:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788521300.481462:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8498:x1875400368094848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.481647:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8498:x1875400368094848:12345-0@lo:502:llog_process_th.0 Request processed in 185us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.481655:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788521300.481718:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8498:1875400368094848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521300.481759:0:8498:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8498:1875400368094976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521300.481805:0:8498:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.481935:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368094976 00000100:00100000:0.0:1788521300.481939:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368094976 00000100:00100000:0.0:1788521300.481956:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788521300.481961:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8498:x1875400368094976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.482078:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8498:x1875400368094976:12345-0@lo:502:llog_process_th.0 Request processed in 116us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.482096:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788521300.482279:0:8498:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.482356:0:8498:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8498:1875400368094976:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788521300.482374:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788521300.482530:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788521300.482548:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788521300.482557:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.482568:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521300.482578:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788521300.482581:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788521300.482583:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788521300.482609:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.482628:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.482637:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.482652:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.482680:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.484248:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75d0c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521300.484953:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095104 00000100:00100000:0.0:1788521300.484963:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095104 00000100:00100000:0.0:1788521300.485018:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788521300.485027:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368095104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521300.485042:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521300.485059:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c5200/0x53df1cebae01638e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016387 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.485188:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c5200/0x53df1cebae01638e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016387 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.485201:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c5200/0x53df1cebae01638e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016387 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.485226:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5200, rc 0) 00000100:00100000:0.0:1788521300.485371:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368095104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 344us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.485378:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788521300.485690:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521300.485708:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.485718:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.485914:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.485949:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.486013:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75d0c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521300.486046:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095232 00000100:00100000:2.0:1788521300.486051:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095232 00000100:00100000:2.0:1788521300.486203:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788521300.486211:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368095232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.486486:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368095232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.486494:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788521300.486559:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.486600:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.486638:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.486927:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.486953:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095360 00000100:00100000:3.0:1788521300.486958:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095360 00000100:00100000:3.0:1788521300.486990:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788521300.486997:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368095360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.487346:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368095360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.487353:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788521300.487509:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.487920:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8499:1875400368095488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521300.487961:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.487992:0:8499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4344a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.488032:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095488 00000100:00100000:3.0:1788521300.488037:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095488 00000100:00100000:3.0:1788521300.488074:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521300.488093:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8499:x1875400368095488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521300.488448:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8499:1875400368095488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521300.488474:0:8499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521300.488484:0:8499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521300.488486:0:8499:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788521300.488491:0:8499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788521300.488515:0:8499:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8499:1875400368095616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.488556:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8499:x1875400368095488:12345-0@lo:502:llog_process_th.0 Request processed in 475us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521300.488563:0:8499:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521300.488564:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788521300.488600:0:8499:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0941fc2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521300.488673:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095616 00000100:00100000:3.0:1788521300.488678:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095616 00000100:00100000:3.0:1788521300.488738:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521300.488746:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8499:x1875400368095616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521300.488907:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8499:x1875400368095616:12345-0@lo:502:llog_process_th.0 Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.488914:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788521300.488935:0:8499:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8499:1875400368095616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521300.488957:0:8499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521300.488961:0:8499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521300.488963:0:8499:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521300.488967:0:8499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788521300.489037:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788521300.489055:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788521300.489066:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.489076:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521300.489095:0:5830:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788521300.489104:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0a489a19c0 from 1 10000000:01000000:2.0:1788521300.489106:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788521300.489131:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.489139:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.489148:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521300.489161:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.489188:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.489216:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521300.489402:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095744 00000100:00100000:1.0:1788521300.489407:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095744 00000100:00100000:1.0:1788521300.489435:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788521300.489444:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368095744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521300.489452:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521300.489463:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166f400/0x53df1cebae01639c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016395 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.489481:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166f400/0x53df1cebae01639c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016395 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.489490:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166f400/0x53df1cebae01639c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016395 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.489498:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166f400, rc 0) 00000100:00100000:1.0:1788521300.489538:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368095744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521300.489543:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788521300.489745:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521300.489758:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.489766:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521300.489839:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521300.489862:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.489875:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521300.489991:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368095872 00000100:00100000:1.0:1788521300.489996:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368095872 00000100:00100000:1.0:1788521300.490011:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788521300.490016:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368095872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521300.490184:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368095872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (321us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521300.490189:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788521300.490230:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368095872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788521300.490249:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788521300.490253:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.490265:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788521300.748756:0:8518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1957ac10 20000000:00000080:3.0:1788521300.748975:0:8518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c0a81dd3000 uarg=0000000000000000 20000000:01000000:3.0:1788521300.749012:0:8518:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788521300.749017:0:8518:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788521300.749021:0:8518:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788521300.750387:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788521300.750538:0:8518:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1788521300.757679:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1788521300.757750:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1788521300.758378:0:8518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1788521300.758405:0:8518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788521300.758435:0:8518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758455:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016111 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758478:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016173 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758485:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01623e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758504:0:8518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758512:0:8518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758668:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.758694:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 9 pid: 5828 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.758726:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096000:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521300.759022:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae01623e expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.759032:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae01623e expref: 18 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.759040:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096128:0@lo:104: 00000100:00100000:3.0:1788521300.759101:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521300.759222:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016173 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.759238:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016173 expref: 18 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.759254:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096256:0@lo:104: 00000100:00100000:3.0:1788521300.759281:0:8518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521300.759983:0:8518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016111 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521300.759994:0:8518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016111 expref: 18 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521300.760003:0:8518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096384:0@lo:104: 00000100:00100000:3.0:1788521300.760025:0:8518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51291a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521300.760095:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788521300.760117:0:5817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.760320:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096128 00000100:00100000:2.0:1788521300.760328:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096128 00000100:00100000:2.0:1788521300.760368:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096256 00000100:00100000:2.0:1788521300.760372:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096256 00000100:00100000:2.0:1788521300.760382:0:8463:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096384 00000100:00100000:2.0:1788521300.760384:0:8463:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096384 00000100:00100000:2.0:1788521300.760396:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521300.760406:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:8518:x1875400368096128:12345-0@lo:104: 00010000:00010000:2.0:1788521300.760430:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760495:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521300.760502:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:8518:x1875400368096128:12345-0@lo:104: Request processed in 98us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.760509:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521300.760527:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521300.760545:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:8518:x1875400368096256:12345-0@lo:104: 00010000:00010000:2.0:1788521300.760552:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760586:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788521300.760591:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75ca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:8518:x1875400368096256:12345-0@lo:104: Request processed in 60us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.760596:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521300.760642:0:8463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521300.760648:0:8463:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:8518:x1875400368096384:12345-0@lo:104: 00010000:00010000:2.0:1788521300.760655:0:8463:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760680:0:8463:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788521300.760685:0:8463:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:8518:x1875400368096384:12345-0@lo:104: Request processed in 38us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.760690:0:8463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788521300.760707:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521300.760712:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760719:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521300.760724:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760732:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521300.760739:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521300.760745:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521300.760795:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760802:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521300.760820:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760838:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4c00/0x53df1cebae01623e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016245 expref: -99 pid: 7636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760851:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521300.760854:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760860:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521300.760863:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760869:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521300.760875:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521300.760880:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521300.760893:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760899:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521300.760912:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760919:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40030400/0x53df1cebae016173 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01617a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760928:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521300.760938:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760943:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031800 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521300.760946:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760952:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521300.760958:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521300.760963:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521300.760976:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760982:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521300.760988:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.760994:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40031800/0x53df1cebae016111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016118 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521300.761008:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521300.761009:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521300.761011:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521300.761019:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521300.761036:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368096512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521300.761067:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.761100:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368096640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521300.761129:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521300.761147:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521300.761152:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368096768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521300.761168:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521300.761386:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096128:0@lo:104: 00000100:00100000:0.0:1788521300.761395:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096256:0@lo:104: 00000100:00100000:0.0:1788521300.761402:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096384:0@lo:104: 00000100:00100000:0.0:1788521300.761628:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096512 00000100:00100000:0.0:1788521300.761633:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096512 00010000:00010000:0.0:1788521300.761656:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01623e expref: 19 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521300.761674:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096640 00000100:00100000:0.0:1788521300.761676:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096640 00010000:00010000:0.0:1788521300.761687:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016173 expref: 20 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521300.761710:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096768 00000100:00100000:0.0:1788521300.761712:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096768 00010000:00010000:0.0:1788521300.761722:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016111 expref: 21 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521300.761733:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521300.761739:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+21:3303:x1875400368096512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521300.761750:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521300.761755:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01623e expref: 21 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.761764:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae01623e expref: 21 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.761797:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0600/0x53df1cebae016245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae01623e expref: 21 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.761810:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521300.761874:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788521300.761883:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788521300.762109:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3303:x1875400368096512:12345-0@lo:103:ldlm_bl.0 Request processed in 368us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.762117:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788521300.762133:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521300.762139:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368096640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521300.762147:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521300.762151:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016173 expref: 19 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.762159:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016173 expref: 19 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.762178:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40030600/0x53df1cebae01617a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016173 expref: 19 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.762321:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521300.762399:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3300:x1875400368096640:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.762406:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788521300.762429:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521300.762436:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3300:x1875400368096768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521300.762444:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521300.762449:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016111 expref: 17 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.762457:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016111 expref: 17 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.762467:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82045e00/0x53df1cebae016118 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016111 expref: 17 pid: 5828 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.762484:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521300.762506:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3300:x1875400368096768:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.762512:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521300.762659:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368096640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521300.762679:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368096768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521300.762915:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368096512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521300.767285:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521300.767346:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048128 00000100:00100000:1.0:1788521300.767354:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048128 00010000:00010000:1.0:1788521300.767392:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 10 pid: 5828 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521300.767444:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1788521300.767454:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2346:x1875400346048128:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521300.767473:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521300.767479:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 10 pid: 5828 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767492:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 10 pid: 5828 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767515:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767524:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767540:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767559:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767897:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767905:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767912:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1a00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521300.767916:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767924:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767935:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521300.767946:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521300.768000:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2346:x1875400346048128:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 547us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521300.768009:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00010000:00010000:0.0:1788521300.768105:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016302 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644024a expref: 9 pid: 5828 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521300.768119:0:8518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8518:1875400368096000:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521300.768146:0:8518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.768163:0:8518:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.768181:0:8518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.768188:0:8518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a1a00/0x53df1cebae0163a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521300.793521:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521300.793567:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048256 00000100:00100000:0.0:1788521300.793576:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048256 00000100:00100000:0.0:1788521300.793620:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:0.0:1788521300.793629:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:5589:x1875400346048256:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521300.793646:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521300.793664:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440289 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.793704:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.796495:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521300.796507:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5800, rc 0) 00000100:00100000:0.0:1788521300.796588:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048256:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 2958us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.796596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:0.0:1788521300.813302:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521300.814245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048384 00000100:00100000:3.0:1788521300.814257:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048384 00000100:00100000:3.0:1788521300.814329:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:3.0:1788521300.814339:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048384:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521300.814639:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048384:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 300us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521300.814647:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:3.0:1788521300.819693:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521300.819944:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048512 00000100:00100000:0.0:1788521300.819954:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048512 00000100:00100000:0.0:1788521300.820007:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:0.0:1788521300.820016:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048512:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521300.820244:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:5589:x1875400346048512:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 228us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.820253:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:1.0:1788521300.855503:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521300.857864:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048640 00000100:00100000:2.0:1788521300.857878:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048640 00000100:00100000:2.0:1788521300.857961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:2.0:1788521300.857972:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:6075:x1875400346048640:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521300.858204:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:6075:x1875400346048640:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 233us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521300.858213:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:0.0:1788521300.920902:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521300.920947:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048768 00000100:00100000:0.0:1788521300.920956:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048768 00000100:00100000:0.0:1788521300.921016:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:0.0:1788521300.921026:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:6075:x1875400346048768:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521300.921259:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:6075:x1875400346048768:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 234us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521300.921267:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 175 00010000:00010000:2.0:1788521300.969183:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788521301.931108:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521301.931115:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a7f66c000 from 4 10000000:01000000:2.0:1788521301.931119:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521301.931160:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.931172:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.931183:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521301.931207:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368096896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.931265:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.931317:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521301.931504:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368096896 00000100:00100000:3.0:1788521301.931513:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368096896 00000100:00100000:3.0:1788521301.931576:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788521301.931584:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368096896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521301.931596:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521301.931608:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0163b1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.931629:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.931639:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.931647:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521301.931693:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368096896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521301.931699:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788521301.931869:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368096896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521301.931883:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.931894:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521301.931942:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.931967:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.931992:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.932084:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097024 00000100:00100000:1.0:1788521301.932088:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097024 00000100:00100000:1.0:1788521301.932120:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788521301.932127:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368097024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.932345:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368097024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.932357:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788521301.932440:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.932469:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.932503:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.932525:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.932583:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097152 00000100:00100000:1.0:1788521301.932588:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097152 00000100:00100000:1.0:1788521301.932615:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788521301.932621:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368097152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.932749:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368097152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.932755:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788521301.932940:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.935337:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8556:1875400368097280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521301.935430:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.935473:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.935525:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097280 00000100:00100000:1.0:1788521301.935532:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097280 00000100:00100000:1.0:1788521301.935586:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521301.935595:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8556:x1875400368097280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521301.936064:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8556:x1875400368097280:12345-0@lo:502:llog_process_th.0 Request processed in 469us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.936073:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788521301.936152:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8556:1875400368097280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521301.936182:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521301.936191:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521301.936194:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521301.936202:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a7f66c000 00000020:00000080:2.0:1788521301.936204:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521301.936283:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8556:1875400368097408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521301.936324:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.936353:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521301.936393:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097408 00000100:00100000:3.0:1788521301.936398:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097408 00000100:00100000:3.0:1788521301.936444:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788521301.936451:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8556:x1875400368097408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.936598:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:8556:x1875400368097408:12345-0@lo:502:llog_process_th.0 Request processed in 147us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521301.936606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788521301.936808:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8556:1875400368097408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521301.936830:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521301.936835:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521301.936838:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788521301.936841:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788521301.937008:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788521301.937025:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521301.937033:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.937051:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521301.937117:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521301.937120:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a75d22000 from 4 10000000:01000000:3.0:1788521301.937123:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521301.937147:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.937154:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.937164:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521301.937178:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521301.937222:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521301.937252:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521301.937419:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097536 00000100:00100000:2.0:1788521301.937425:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097536 00000100:00100000:2.0:1788521301.937460:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788521301.937468:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368097536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521301.937477:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521301.937490:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0163bf expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.937510:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0163bf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.937519:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0163bf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.937528:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea400, rc 0) 00000100:00100000:2.0:1788521301.937673:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368097536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521301.937680:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788521301.937715:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521301.937728:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.937748:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521301.937823:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.937849:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.937868:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521301.937879:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097664 00000100:00100000:2.0:1788521301.937883:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097664 00000100:00100000:2.0:1788521301.937903:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788521301.937909:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368097664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.938178:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368097664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521301.938186:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788521301.938213:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.938240:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.938274:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.938288:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a463a0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521301.938298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097792 00000100:00100000:2.0:1788521301.938301:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097792 00000100:00100000:2.0:1788521301.938318:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788521301.938324:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368097792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.938466:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368097792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521301.938472:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788521301.938510:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368097792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521301.962856:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8558:1875400368097920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.962931:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521301.962978:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.963213:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368097920 00000100:00100000:1.0:1788521301.963220:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368097920 00000100:00100000:1.0:1788521301.963265:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788521301.963273:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8558:x1875400368097920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521301.970544:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8558:x1875400368097920:12345-0@lo:502:llog_process_th.0 Request processed in 7261us (7602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.970560:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788521301.982007:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8558:1875400368097920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521301.982051:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788521301.982062:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521301.982064:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788521301.982071:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a75d22000 00000020:00000080:2.0:1788521301.982074:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788521301.982162:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8558:1875400368098048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521301.982227:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.982265:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48ac80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521301.983023:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098048 00000100:00100000:3.0:1788521301.983030:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098048 00000100:00100000:3.0:1788521301.983081:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788521301.983090:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8558:x1875400368098048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.983302:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:8558:x1875400368098048:12345-0@lo:502:llog_process_th.0 Request processed in 212us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521301.983318:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788521301.983981:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8558:1875400368098048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788521301.984013:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788521301.984020:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788521301.984022:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788521301.984029:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788521301.984091:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788521301.984111:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521301.984121:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.984132:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521301.984142:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521301.984145:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a4f90d800 from 4 10000000:01000000:2.0:1788521301.984148:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521301.984176:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.984193:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521301.984203:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521301.984219:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368098176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521301.984257:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521301.984289:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48ac80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.985493:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098176 00000100:00100000:1.0:1788521301.985504:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098176 00000100:00100000:1.0:1788521301.985558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788521301.985576:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368098176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521301.985598:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521301.985615:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0163cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521301.985641:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0163cd expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521301.985652:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0163cd expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521301.985660:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166f000, rc 0) 00000100:00100000:1.0:1788521301.985719:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368098176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.985725:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788521301.985791:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368098176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521301.985815:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521301.985825:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521301.985894:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368098304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.985922:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521301.985939:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7a8860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.985953:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098304 00000100:00100000:1.0:1788521301.985956:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098304 00000100:00100000:1.0:1788521301.985977:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788521301.985982:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368098304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.986207:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368098304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.986215:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788521301.986242:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368098304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.986267:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368098432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.986302:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521301.986313:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7a8860c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521301.986323:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098432 00000100:00100000:1.0:1788521301.986327:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098432 00000100:00100000:1.0:1788521301.986343:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788521301.986349:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368098432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521301.986492:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368098432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521301.986499:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788521301.986533:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368098432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521301.988057:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8563:1875400368098560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.988120:0:8563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521301.988153:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098560 00000100:00100000:3.0:1788521301.988158:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098560 00000100:00100000:3.0:1788521301.988191:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788521301.988199:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:8563:x1875400368098560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.988374:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:8563:x1875400368098560:12345-0@lo:502:llog_process_th.0 Request processed in 175us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521301.988381:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788521301.988432:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521301.988451:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8563:1875400368098560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521301.988478:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521301.988488:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521301.988490:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788521301.988497:0:8563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a4f90d800 00000020:00000080:3.0:1788521301.988500:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521301.990357:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8563:1875400368098688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.990435:0:8563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521301.990472:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098688 00000100:00100000:3.0:1788521301.990479:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098688 00000100:00100000:3.0:1788521301.990518:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788521301.990527:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:8563:x1875400368098688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521301.990735:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:8563:x1875400368098688:12345-0@lo:502:llog_process_th.0 Request processed in 208us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521301.990751:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788521301.990814:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521301.990833:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:8563:1875400368098688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521301.992400:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521301.992422:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521301.992425:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788521301.992430:0:8563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788521301.992506:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788521301.992527:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521301.992538:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.992551:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521301.994902:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521302.633669:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521302.633693:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368098816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521302.633760:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521302.638942:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098816 00000100:00100000:0.0:1788521302.638958:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098816 00000100:00100000:0.0:1788521302.639098:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521302.639113:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368098816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521302.639172:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521302.639251:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368098816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (5490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521302.639259:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788521302.646766:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f2a00 x1875400368098816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521302.646807:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368098816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521302.648989:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521303.017924:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521304.041015:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521304.169322:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368098944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521304.169409:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521304.169923:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368099200:0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.169966:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368099328:0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.170023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521304.170062:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521304.170068:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368099456:0@lo:400:kworker.0 00000100:00100000:2.0:1788521304.170069:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368099072:0@lo:400:kworker.0 00000100:00100000:0.0:1788521304.170137:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368098944 00000100:00100000:0.0:1788521304.170146:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368098944 00000100:00100000:0.0:1788521304.170211:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521304.170222:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368098944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521304.170254:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521304.179576:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521304.179664:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099456 00000100:00100000:3.0:1788521304.179674:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099456 00000100:00100000:3.0:1788521304.179746:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521304.179759:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.179877:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368099456:12345-0@lo:400:kworker.0 Request processed in 121us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.179885:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788521304.179931:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31d500 x1875400368099456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521304.179948:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368099456:0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.180098:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099328 00000100:00100000:3.0:1788521304.180103:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099328 00000100:00100000:3.0:1788521304.180133:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521304.180140:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368099328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.180178:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368099328:12345-0@lo:400:kworker.0 Request processed in 38us (10155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.180184:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521304.180211:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368099328:0@lo:400:kworker.0 00000100:00080000:3.0:1788521304.180236:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521304.180240:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521304.180243:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521304.182106:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521304.182177:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368099584:0@lo:400:kworker.0 00000100:00100000:2.0:1788521304.182239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521304.182264:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099072 00000100:00100000:3.0:1788521304.182286:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099072 00000100:00100000:2.0:1788521304.182298:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099584 00000100:00100000:2.0:1788521304.182303:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099584 00000100:00100000:2.0:1788521304.182355:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521304.182363:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368099584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.182403:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788521304.182412:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368099072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521304.182435:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368099584:12345-0@lo:400:kworker.0 Request processed in 71us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.182457:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368099072:12345-0@lo:400:kworker.0 Request processed in 47us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.182475:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788521304.182519:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788521304.182547:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521304.182573:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368099072:0@lo:400:kworker.0 00000100:00100000:2.0:1788521304.182586:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368099584:0@lo:400:kworker.0 00000100:00100000:1.0:1788521304.187105:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521304.187437:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368098944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17215us (18024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521304.187450:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788521304.187734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099200 00000100:00100000:3.0:1788521304.187744:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099200 00000100:00100000:3.0:1788521304.187808:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521304.187817:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368099200:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788521304.188261:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f0a80 x1875400368098944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521304.188286:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368098944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521304.190269:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368099200:0@lo:400:kworker.0 00000100:00100000:3.0:1788521304.191245:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368099200:12345-0@lo:400:kworker.0 Request processed in 3423us (4142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.191260:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521304.195118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521304.195166:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521304.195181:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346048896 00000100:00100000:3.0:1788521304.195191:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346048896 00000100:00100000:0.0:1788521304.195197:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521304.195231:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521304.195241:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:3.0:1788521304.195251:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346048896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521304.195330:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049152 00000100:00100000:2.0:1788521304.195334:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049152 00000100:00100000:2.0:1788521304.195379:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049280 00000100:00100000:2.0:1788521304.195382:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049280 00000100:00100000:2.0:1788521304.195414:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1788521304.195422:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346049152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:0.0:1788521304.195474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521304.195478:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521304.196018:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346048896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 766us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.196026:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:1.0:1788521304.196049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049024 00000100:00100000:1.0:1788521304.196054:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049024 00000100:00100000:3.0:1788521304.196064:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1788521304.196070:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346049280:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521304.196095:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:1.0:1788521304.196117:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346049024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521304.196243:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346049152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 820us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521304.196249:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00080000:0.0:1788521304.197965:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521304.198180:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346049280:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 2103us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521304.198191:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1788521304.199418:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346049024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 3296us (4212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521304.199430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00010000:00010000:2.0:1788521305.064937:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521306.092935:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521307.114356:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521307.753961:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521307.753989:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368099712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521307.754064:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521307.754191:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099712 00000100:00100000:0.0:1788521307.754199:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099712 00000100:00100000:0.0:1788521307.754258:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788521307.754268:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368099712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521307.754309:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521307.754355:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368099712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521307.754361:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788521307.754476:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521307.754516:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f1180 x1875400368099712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521323 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521307.754535:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368099712:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788521308.144667:0:8818:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788521308.147520:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521309.163521:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521309.293923:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521309.294066:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368100352:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521309.294137:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521309.294143:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368099968:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521309.294173:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368100480:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294190:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521309.294217:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368100096:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294239:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521309.294257:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521309.294262:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368100224:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294282:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521309.294314:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099840 00000100:00100000:1.0:1788521309.294322:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099840 00000100:00100000:1.0:1788521309.294375:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788521309.294384:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368099840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294427:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368099840:12345-0@lo:400:kworker.0 Request processed in 44us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521309.294434:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788521309.294468:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100352 00000100:00100000:1.0:1788521309.294483:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100352 00000100:00100000:1.0:1788521309.294519:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368099968 00000100:00100000:1.0:1788521309.294521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368099968 00000100:00100000:1.0:1788521309.294532:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100096 00000100:00100000:1.0:1788521309.294534:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100096 00000100:00100000:1.0:1788521309.294545:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521309.294550:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368100352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294577:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368100352:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521309.294582:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788521309.294593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521309.294599:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368099968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294623:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368099968:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521309.294628:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521309.294638:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521309.294643:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368100096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294671:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368100096:12345-0@lo:400:kworker.0 Request processed in 28us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521309.294677:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788521309.294693:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100480 00000100:00100000:1.0:1788521309.294696:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100480 00000100:00100000:1.0:1788521309.294717:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100224 00000100:00100000:1.0:1788521309.294720:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100224 00000100:00100000:1.0:1788521309.294738:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521309.294743:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368100480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294769:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368100480:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521309.294800:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521309.294811:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521309.294816:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368100224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294840:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368100224:12345-0@lo:400:kworker.0 Request processed in 24us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521309.294845:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788521309.294866:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521309.294870:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521309.294872:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788521309.294897:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31c380 x1875400368100224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521309.294909:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368100224:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294918:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368100096:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294941:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368099968:0@lo:400:kworker.0 00010000:00080000:1.0:1788521309.294949:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31ea00 x1875400368100480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521309.294956:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368100480:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294962:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368099840:0@lo:400:kworker.0 00000100:00100000:1.0:1788521309.294970:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368100352:0@lo:400:kworker.0 00000100:00100000:3.0:1788521309.296707:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521309.304406:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368100608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521309.304479:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521309.304522:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100608 00000100:00100000:3.0:1788521309.304529:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100608 00000100:00100000:3.0:1788521309.304586:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788521309.304595:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368100608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521309.304628:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521309.304670:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368100608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521309.304676:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788521309.304712:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75413100 x1875400368100608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521309.304731:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368100608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521309.304845:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521309.304870:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521309.304897:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521309.304919:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521309.304938:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049792 00000100:00100000:2.0:1788521309.304942:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049792 00000100:00100000:2.0:1788521309.304975:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049664 00000100:00100000:2.0:1788521309.304978:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049664 00000100:00100000:2.0:1788521309.304997:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:2.0:1788521309.305004:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346049792:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521309.305046:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346049792:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 43us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521309.305052:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:2.0:1788521309.305063:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1788521309.305068:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346049664:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521309.305100:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346049664:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521309.305105:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00080000:2.0:1788521309.305120:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521309.305124:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521309.305389:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049536 00000100:00100000:3.0:1788521309.305394:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049536 00000100:00100000:3.0:1788521309.305438:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1788521309.305446:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346049536:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521309.305495:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346049536:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 50us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521309.305501:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1788521309.305519:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049408 00000100:00100000:3.0:1788521309.305522:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049408 00000100:00100000:3.0:1788521309.305544:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:3.0:1788521309.305550:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2345:x1875400346049408:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521309.305572:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2345:x1875400346049408:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521309.305577:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00080000:2.0:1788521309.305798:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521310.185972:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521311.212248:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521312.236149:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521312.876300:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368100736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521312.876485:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521312.876571:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100736 00000100:00100000:1.0:1788521312.876579:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100736 00000100:00100000:1.0:1788521312.876626:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521312.876636:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368100736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521312.876670:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521312.876711:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368100736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521312.876717:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788521312.876736:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521312.876762:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75411c00 x1875400368100736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521312.876796:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368100736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521313.257132:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521314.285078:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521314.416397:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368100864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521314.416475:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521314.416550:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100864 00000100:00100000:1.0:1788521314.416557:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100864 00000100:00100000:1.0:1788521314.416609:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521314.416619:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368100864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521314.416652:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521314.416692:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368100864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521314.416700:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788521314.416719:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788521314.416755:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75411c00 x1875400368100864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521314.416789:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368100864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521314.419032:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368101120:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419088:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521314.419122:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521314.419128:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368101248:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521314.419213:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101120 00000100:00100000:0.0:1788521314.419220:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101120 00000100:00100000:0.0:1788521314.419263:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101248 00000100:00100000:0.0:1788521314.419266:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101248 00000100:00100000:0.0:1788521314.419294:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521314.419302:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368101120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419358:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368101120:12345-0@lo:400:kworker.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.419366:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521314.419383:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521314.419390:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368101248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419414:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368101248:12345-0@lo:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.419420:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788521314.419445:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521314.419471:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368101248:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419481:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368101120:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419503:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368101376:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521314.419549:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521314.419555:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368100992:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419579:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521314.419602:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368101504:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419620:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521314.419651:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101376 00000100:00100000:0.0:1788521314.419655:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101376 00000100:00100000:0.0:1788521314.419685:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521314.419692:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368101376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419725:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368101376:12345-0@lo:400:kworker.0 Request processed in 33us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.419731:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788521314.419747:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368100992 00000100:00100000:0.0:1788521314.419751:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368100992 00000100:00100000:0.0:1788521314.419792:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788521314.419799:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368100992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419826:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368100992:12345-0@lo:400:kworker.0 Request processed in 28us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.419844:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1788521314.419870:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521314.419878:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101504 00000100:00100000:0.0:1788521314.419881:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101504 00000100:00100000:0.0:1788521314.419903:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788521314.419909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368101504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419933:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368101504:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.419939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788521314.419953:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521314.419966:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368100992:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.419976:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368101504:0@lo:400:kworker.0 00010000:00080000:0.0:1788521314.419987:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f1c00 x1875400368101376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521314.420008:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368101376:0@lo:400:kworker.0 00000100:00100000:0.0:1788521314.425719:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521314.425759:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521314.425813:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521314.425910:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521314.425940:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050176 00000100:00100000:0.0:1788521314.425949:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050176 00000100:00100000:0.0:1788521314.425995:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050304 00000100:00100000:0.0:1788521314.425998:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050304 00000100:00100000:0.0:1788521314.426018:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1788521314.426027:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2344:x1875400346050176:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:0.0:1788521314.426060:0:8219:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016310 00000100:00080000:0.0:1788521314.426069:0:8219:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f2b7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521314.426103:0:8219:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788521314.426631:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+2:2344:x1875400346050176:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 603us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.426640:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1788521314.426654:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1788521314.426661:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2344:x1875400346050304:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:0.0:1788521314.426674:0:8219:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016317 00000100:00080000:0.0:1788521314.426681:0:8219:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab97800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521314.426702:0:8219:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788521314.428493:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521314.428515:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050048 00000100:00100000:2.0:1788521314.428523:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050048 00000100:00100000:2.0:1788521314.428578:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:2.0:1788521314.428588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346050048:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521314.428644:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346050048:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 58us (2832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521314.428653:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00080000:2.0:1788521314.428679:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521314.428684:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521314.428687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521314.429061:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+2:2344:x1875400346050304:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 2399us (3149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521314.429071:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1788521314.430995:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346049920 00000100:00100000:3.0:1788521314.431005:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346049920 00000100:00100000:3.0:1788521314.431051:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:3.0:1788521314.431060:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346049920:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521314.431115:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346049920:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 56us (5354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521314.431122:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 196 00010000:00010000:0.0:1788521314.431269:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521314.502638:0:9062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing yml_node 00000001:00100000:2.0:1788521315.096418:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:2.0:1788521315.096487:0:6716:0:(genops.c:885:class_export_put()) final put ffff8c0a7f2b5000/0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:2.0:1788521315.096517:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f2b5000/0ec78abe-db90-4086-b379-6c867e47751e for lustre-OST0000 00000020:00000080:2.0:1788521315.096560:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7f2b7800 for lustre-OST0000 00010000:00010000:3.0:1788521315.308869:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521316.332551:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521317.361331:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521317.994817:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368101632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521317.994889:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521317.995104:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101632 00000100:00100000:1.0:1788521317.995113:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101632 00000100:00100000:1.0:1788521317.995178:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521317.995187:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368101632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521317.995233:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521317.995281:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368101632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521317.995288:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788521317.995341:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75411c00 x1875400368101632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521317.995359:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368101632:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521317.995802:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788521318.070435:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:2.0:1788521318.070447:0:7652:0:(genops.c:885:class_export_put()) final put ffff8c0a7ab90000/0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:0.0:1788521318.070655:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7ab90000/0ec78abe-db90-4086-b379-6c867e47751e for lustre-OST0001 00000020:00000080:0.0:1788521318.070719:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7ab97800 for lustre-OST0001 00010000:00010000:1.0:1788521318.384243:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521319.402200:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521319.529277:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368101760:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529370:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521319.529455:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368102272:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521319.529510:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521319.529515:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368102144:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521319.529587:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368102016:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521319.529629:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788521319.529634:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368101888:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529668:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521319.529694:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368102400:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529721:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521319.529762:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102272 00000100:00100000:2.0:1788521319.529770:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102272 00000100:00100000:2.0:1788521319.529849:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102016 00000100:00100000:2.0:1788521319.529853:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102016 00000100:00100000:2.0:1788521319.529867:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101888 00000100:00100000:2.0:1788521319.529869:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101888 00000100:00100000:2.0:1788521319.529885:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788521319.529893:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368102272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.529943:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368102272:12345-0@lo:400:kworker.0 Request processed in 50us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521319.529950:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788521319.529970:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521319.529976:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368102016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.530008:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368102016:12345-0@lo:400:kworker.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521319.530025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788521319.530040:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521319.530045:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368101888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.530075:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368101888:12345-0@lo:400:kworker.0 Request processed in 30us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521319.530080:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788521319.530100:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102144 00000100:00100000:2.0:1788521319.530104:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102144 00000100:00100000:2.0:1788521319.530127:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102400 00000100:00100000:2.0:1788521319.530130:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102400 00000100:00100000:2.0:1788521319.530147:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521319.530153:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368102144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.530183:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368102144:12345-0@lo:400:kworker.0 Request processed in 31us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521319.530189:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521319.530201:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521319.530207:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368102400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.530234:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368102400:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521319.530239:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521319.530618:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368101760 00000100:00100000:1.0:1788521319.530623:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368101760 00000100:00100000:1.0:1788521319.530667:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788521319.530686:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368101760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521319.530731:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368101760:12345-0@lo:400:kworker.0 Request processed in 47us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521319.530738:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788521319.530855:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521319.530873:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368102528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521319.530906:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788521319.535742:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521319.535752:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521319.535755:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521319.535829:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31c000 x1875400368102144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521319.535866:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368102144:0@lo:400:kworker.0 00000100:00100000:3.0:1788521319.535880:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368101760:0@lo:400:kworker.0 00000100:00100000:3.0:1788521319.535891:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368102272:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.538796:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75413100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368101888:0@lo:400:kworker.0 00010000:00080000:2.0:1788521319.538819:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31dc00 x1875400368102400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521319.538829:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368102400:0@lo:400:kworker.0 00000100:00100000:2.0:1788521319.538842:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368102016:0@lo:400:kworker.0 00000100:00100000:1.0:1788521319.540139:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102528 00000100:00100000:1.0:1788521319.540150:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102528 00000100:00100000:1.0:1788521319.540222:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521319.540232:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368102528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521319.540269:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521319.540363:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368102528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (9455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521319.540381:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788521319.540436:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f1180 x1875400368102528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521319.540455:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368102528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521319.541822:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521319.541858:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521319.541892:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050560 00000100:00100000:0.0:1788521319.541900:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050560 00000100:00100000:0.0:1788521319.541954:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1788521319.541964:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346050560:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521319.542030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346050560:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 67us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521319.542037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:2.0:1788521319.542330:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050432 00000100:00100000:2.0:1788521319.542335:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050432 00000100:00100000:2.0:1788521319.542363:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00100000:2.0:1788521319.542370:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346050432:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521319.542409:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346050432:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521319.542416:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00080000:2.0:1788521319.542458:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521320.426564:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521320.724005:0:9256:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:2.0:1788521321.448856:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521322.473417:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521323.116651:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521323.116677:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368102656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521323.116750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521323.117239:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102656 00000100:00100000:0.0:1788521323.117249:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102656 00000100:00100000:0.0:1788521323.117339:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788521323.117348:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368102656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521323.117384:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521323.117437:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368102656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521323.117444:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788521323.117463:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521323.117480:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368102656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521323.117530:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368102656:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521323.501543:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521324.350853:0:9353:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:0.0:1788521324.522394:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521324.651445:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368103168:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.651754:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.651839:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788521324.651847:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368102784:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.651879:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.651906:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368103296:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.651930:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.651955:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368102912:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.651977:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.651995:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368103424:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.652089:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.652112:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521324.652126:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.652150:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.652185:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103168 00000100:00100000:2.0:1788521324.652193:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103168 00000100:00100000:2.0:1788521324.652238:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103424 00000100:00100000:2.0:1788521324.652241:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103424 00000100:00100000:2.0:1788521324.652284:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521324.652294:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368103168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.652346:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368103168:12345-0@lo:400:kworker.0 Request processed in 54us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.652353:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788521324.652370:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521324.652376:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368103424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.652407:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368103424:12345-0@lo:400:kworker.0 Request processed in 31us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.652414:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521324.652431:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102784 00000100:00100000:2.0:1788521324.652434:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102784 00000100:00100000:2.0:1788521324.652456:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788521324.652463:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368102784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.652803:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368102784:12345-0@lo:400:kworker.0 Request processed in 309us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.652811:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788521324.652841:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103296 00000100:00100000:2.0:1788521324.652845:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103296 00000100:00100000:2.0:1788521324.652873:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368102912 00000100:00100000:2.0:1788521324.652876:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368102912 00000100:00100000:2.0:1788521324.652886:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103040 00000100:00100000:2.0:1788521324.652895:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103040 00000100:00100000:2.0:1788521324.652913:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521324.652919:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368103296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.652951:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368103296:12345-0@lo:400:kworker.0 Request processed in 32us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.652957:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521324.652968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521324.652974:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368102912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.653001:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368102912:12345-0@lo:400:kworker.0 Request processed in 28us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.653007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521324.653215:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521324.653226:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368103040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521324.653272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368103040:12345-0@lo:400:kworker.0 Request processed in 49us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521324.653278:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788521324.653401:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521324.653407:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521324.653443:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.653455:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368102912:0@lo:400:kworker.0 00010000:00080000:2.0:1788521324.653467:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a81da4000 x1875400368103424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521324.653478:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368103424:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.653593:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368102784:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.653605:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368103296:0@lo:400:kworker.0 00010000:00080000:2.0:1788521324.653616:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f7b5f80 x1875400368103168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521324.653625:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368103168:0@lo:400:kworker.0 00000100:00100000:2.0:1788521324.657759:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368103552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521324.657847:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521324.657911:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103552 00000100:00100000:2.0:1788521324.657918:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103552 00000100:00100000:2.0:1788521324.657966:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521324.657976:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368103552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521324.658006:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521324.658264:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368103552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 288us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.658272:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788521324.658316:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368103552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521324.658336:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368103552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521324.658608:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521324.658642:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521324.658674:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050816 00000100:00100000:3.0:1788521324.658679:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050816 00000100:00100000:3.0:1788521324.658716:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1788521324.658723:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346050816:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521324.658790:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346050816:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 49us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521324.658798:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00080000:2.0:1788521324.658941:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521324.660208:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050688 00000100:00100000:2.0:1788521324.660218:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050688 00000100:00100000:2.0:1788521324.660274:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:2.0:1788521324.660284:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2345:x1875400346050688:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521324.660335:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2345:x1875400346050688:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 53us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521324.660342:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 200 00010000:00010000:0.0:1788521325.547653:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521326.570119:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521327.594961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521327.651638:0:9451:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:1.0:1788521328.234640:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521328.234664:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368103680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521328.234730:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521328.235903:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103680 00000100:00100000:0.0:1788521328.235915:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103680 00000100:00100000:0.0:1788521328.236000:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521328.236010:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368103680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521328.236052:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521328.236117:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368103680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521328.236125:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788521328.236220:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368103680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521328.236250:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368103680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521328.236559:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788521328.617071:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521329.315150:0:9499:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 07:28:47 EDT 2026 00010000:00010000:0.0:1788521329.640996:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521329.769154:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368104192:0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.769233:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521329.769280:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104192 00000100:00100000:0.0:1788521329.769288:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104192 00000100:00100000:1.0:1788521329.769304:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788521329.769312:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368103808:0@lo:400:kworker.0 00000100:00100000:0.0:1788521329.769335:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521329.769345:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368104192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521329.769509:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368103936:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788521329.770035:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521329.770048:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368104064:0@lo:400:kworker.0 00000100:00100000:0.0:1788521329.778364:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368104192:12345-0@lo:400:kworker.0 Request processed in 9012us (9121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521329.778381:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521329.780832:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521329.780905:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368104320:0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.780959:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521329.781618:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368104192:0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.781666:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104320 00000100:00100000:1.0:1788521329.781763:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104320 00000100:00100000:1.0:1788521329.781837:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521329.781845:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368104320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.781905:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368104320:12345-0@lo:400:kworker.0 Request processed in 60us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521329.781912:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788521329.781947:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f794e00 x1875400368104320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521329.781957:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368104320:0@lo:400:kworker.0 00000100:00100000:2.0:1788521329.782376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521329.782413:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368104448:0@lo:400:kworker.0 00000100:00100000:2.0:1788521329.782450:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521329.782530:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521329.782556:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521329.782574:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103808 00000100:00100000:2.0:1788521329.782578:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103808 00000100:00100000:2.0:1788521329.782602:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346050944 00000100:00100000:2.0:1788521329.782604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346050944 00000100:00100000:2.0:1788521329.782619:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788521329.782625:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368103808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521329.782662:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368103808:12345-0@lo:400:kworker.0 Request processed in 37us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521329.782668:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788521329.782840:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:2.0:1788521329.782847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346050944:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521329.782886:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346050944:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521329.782892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:2.0:1788521329.782913:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104448 00000100:00100000:2.0:1788521329.782916:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104448 00000100:00100000:2.0:1788521329.782946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051072 00000100:00100000:2.0:1788521329.782949:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051072 00000100:00100000:2.0:1788521329.782968:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521329.782975:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368104448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521329.783320:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368104448:12345-0@lo:400:kworker.0 Request processed in 344us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521329.783388:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521329.783405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:2.0:1788521329.783423:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346051072:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521329.783452:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346051072:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521329.783458:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:2.0:1788521329.783492:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368104448:0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.784870:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368103936 00000100:00100000:1.0:1788521329.784881:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368103936 00000100:00100000:1.0:1788521329.784934:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521329.784943:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368103936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521329.784975:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521329.785060:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368103936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521329.785066:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521329.785119:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368103808:0@lo:400:kworker.0 00010000:00080000:1.0:1788521329.785692:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368103936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521329.785712:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368103936:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788521329.785765:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521329.785770:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521329.786471:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521329.786515:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368104576:0@lo:400:kworker.0 00000100:00100000:3.0:1788521329.786570:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521329.786668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104064 00000100:00100000:2.0:1788521329.786753:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104064 00000100:00100000:2.0:1788521329.786895:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788521329.786905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368104064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521329.786963:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368104064:12345-0@lo:400:kworker.0 Request processed in 60us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521329.786970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521329.787044:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104576 00000100:00100000:0.0:1788521329.787045:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368104064:0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.787051:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104576 00000100:00100000:1.0:1788521329.787089:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521329.787120:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368104576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.787171:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368104576:12345-0@lo:400:kworker.0 Request processed in 53us (600us total) trans 0 rc 0/0 00010000:00080000:3.0:1788521329.792997:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f794000 x1875400368104576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521329.793016:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368104576:0@lo:400:kworker.0 00000100:00100000:1.0:1788521329.793791:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788521330.667961:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521331.690172:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521332.714008:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521333.353387:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368104704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521333.353501:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521333.353707:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104704 00000100:00100000:0.0:1788521333.353736:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104704 00000100:00100000:0.0:1788521333.353849:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521333.353861:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368104704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521333.353909:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521333.353963:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368104704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521333.353971:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788521333.354398:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788521333.354473:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368104704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521333.354501:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368104704:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521333.741356:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521334.761031:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521334.889024:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368104832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521334.889120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521334.889270:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104832 00000100:00100000:1.0:1788521334.889281:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104832 00000100:00100000:1.0:1788521334.889390:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521334.889402:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368104832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521334.889448:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521334.889498:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521334.889500:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368104832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521334.889508:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788521334.889653:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31ea00 x1875400368104832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521334.889674:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368104832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521334.891910:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368105344:0@lo:400:kworker.0 00000100:00100000:1.0:1788521334.891987:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521334.892034:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521334.892040:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368105216:0@lo:400:kworker.0 00000100:00100000:1.0:1788521334.892065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521334.892111:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105344 00000100:00100000:1.0:1788521334.892120:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105344 00000100:00100000:1.0:1788521334.892175:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521334.892197:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368105344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521334.892253:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368105344:12345-0@lo:400:kworker.0 Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521334.892261:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788521334.892308:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e21b480 x1875400368105344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521334.892325:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368105344:0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895367:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368104960:0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895473:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521334.895528:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368105472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895559:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521334.895588:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521334.895596:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368105088:0@lo:400:kworker.0 00000100:00100000:1.0:1788521334.895616:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368104960 00000100:00100000:3.0:1788521334.895618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521334.895626:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368104960 00000100:00100000:3.0:1788521334.895654:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105216 00000100:00100000:3.0:1788521334.895658:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105216 00000100:00100000:1.0:1788521334.895681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788521334.895689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895695:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105472 00000100:00100000:3.0:1788521334.895698:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105472 00000100:00100000:3.0:1788521334.895711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105088 00000100:00100000:3.0:1788521334.895713:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105088 00000100:00100000:3.0:1788521334.895727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521334.895733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368105216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521334.895761:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368104960:12345-0@lo:400:kworker.0 Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521334.895767:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368105216:12345-0@lo:400:kworker.0 Request processed in 36us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521334.895769:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788521334.895792:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521334.895807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521334.895812:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368105472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895839:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368105472:12345-0@lo:400:kworker.0 Request processed in 27us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521334.895856:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521334.895871:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521334.895876:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368105088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895904:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368105088:12345-0@lo:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521334.895909:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788521334.895938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521334.895975:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368105088:0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895984:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368104960:0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.895993:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368105472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521334.896028:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368105216:0@lo:400:kworker.0 00000100:00100000:2.0:1788521334.910056:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521334.910118:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521334.910235:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051328 00000100:00100000:1.0:1788521334.910257:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051328 00000100:00100000:1.0:1788521334.910335:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:1.0:1788521334.910346:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346051328:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521334.910442:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346051328:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 97us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521334.910449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00080000:2.0:1788521334.910642:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521334.911271:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051200 00000100:00100000:3.0:1788521334.911283:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051200 00000100:00100000:3.0:1788521334.911344:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 204 00000100:00100000:3.0:1788521334.911355:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346051200:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521334.911414:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346051200:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 62us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521334.911422:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 204 00010000:00010000:1.0:1788521335.787655:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521336.809100:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521337.839466:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521338.472935:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368105600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521338.473084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521338.473400:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105600 00000100:00100000:1.0:1788521338.473408:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105600 00000100:00100000:1.0:1788521338.473475:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521338.473485:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368105600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521338.473517:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521338.473575:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368105600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521338.473583:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788521338.473687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521338.474423:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a458e1500 x1875400368105600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521338.474442:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368105600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521338.862530:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521339.882845:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521340.011103:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368105728:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.011236:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368106240:0@lo:400:kworker.0 00000100:00100000:1.0:1788521340.011237:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368105984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011262:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.011284:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788521340.011290:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368105856:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011309:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.011325:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368106368:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011529:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.011570:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368106112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.011627:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105728 00000100:00100000:2.0:1788521340.011630:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106368 00000100:00100000:3.0:1788521340.011634:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105728 00000100:00100000:2.0:1788521340.011634:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106368 00000100:00100000:2.0:1788521340.011668:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106112 00000100:00100000:2.0:1788521340.011670:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106112 00000100:00100000:3.0:1788521340.011671:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788521340.011679:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368105728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521340.011686:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521340.011702:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368106368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011724:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368105728:12345-0@lo:400:kworker.0 Request processed in 46us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521340.011729:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368106368:12345-0@lo:400:kworker.0 Request processed in 30us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521340.011731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788521340.011735:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788521340.011745:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521340.011750:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368106112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011766:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106240 00000100:00100000:3.0:1788521340.011769:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106240 00000100:00100000:2.0:1788521340.011807:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368106112:12345-0@lo:400:kworker.0 Request processed in 56us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521340.011811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105856 00000100:00100000:2.0:1788521340.011813:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521340.011814:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105856 00000100:00080000:2.0:1788521340.011826:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521340.011830:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521340.011831:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788521340.011833:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521340.011836:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368106240:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788521340.011853:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e219500 x1875400368106112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521340.011863:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368106240:12345-0@lo:400:kworker.0 Request processed in 27us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521340.011866:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368106112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011873:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788521340.011886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521340.011892:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.011917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368105856:12345-0@lo:400:kworker.0 Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521340.011922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788521340.011941:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.011976:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368105984 00000100:00100000:3.0:1788521340.011979:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368105984 00000100:00100000:3.0:1788521340.011999:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521340.012005:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368105984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.012036:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368105984:12345-0@lo:400:kworker.0 Request processed in 32us (94us total) trans 0 rc 0/0 00000100:00080000:2.0:1788521340.012083:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521340.012160:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521340.012180:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368106496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521340.012205:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521340.012236:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368105984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.012261:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368105856:0@lo:400:kworker.0 00000100:00100000:1.0:1788521340.012337:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106496 00000100:00100000:1.0:1788521340.012342:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106496 00000100:00100000:1.0:1788521340.012369:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521340.012375:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368106496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521340.012399:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788521340.012905:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e21b100 x1875400368106368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521340.012915:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368106368:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.019677:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368106240:0@lo:400:kworker.0 00000100:00100000:3.0:1788521340.019694:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368105728:0@lo:400:kworker.0 00000100:00100000:0.0:1788521340.019906:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521340.019990:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521340.020423:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051584 00000100:00100000:3.0:1788521340.020430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051584 00000100:00100000:3.0:1788521340.020498:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:3.0:1788521340.020508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346051584:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521340.020546:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051456 00000100:00100000:2.0:1788521340.020551:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051456 00000100:00100000:2.0:1788521340.020579:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:2.0:1788521340.020584:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2346:x1875400346051456:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521340.020625:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2346:x1875400346051456:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (720us total) trans 0 rc 0/0 00000100:00080000:0.0:1788521340.020625:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521340.020631:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:3.0:1788521340.020704:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346051584:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 197us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521340.020711:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:0.0:1788521340.021325:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368106496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8948us (9117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521340.021334:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788521340.021551:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e218000 x1875400368106496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521340.021569:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368106496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521340.904907:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521341.929333:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521342.962027:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521343.594046:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521343.594070:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368106624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521343.594149:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521343.594219:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106624 00000100:00100000:0.0:1788521343.594227:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106624 00000100:00100000:0.0:1788521343.594298:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788521343.594308:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368106624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521343.594344:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521343.594387:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368106624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521343.594394:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788521343.594414:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521343.594443:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45631500 x1875400368106624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521343.594475:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368106624:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521343.977020:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521345.002465:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521345.129119:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368106752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521345.129187:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521345.129367:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106752 00000100:00100000:1.0:1788521345.129376:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106752 00000100:00100000:1.0:1788521345.129444:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788521345.129453:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368106752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521345.129487:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521345.129527:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368106752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521345.129534:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788521345.129609:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e219c00 x1875400368106752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521345.129627:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368106752:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788521345.129687:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521345.129937:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368107008:0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.129972:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521345.130018:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521345.130024:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368107136:0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.130046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521345.130116:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368106880:0@lo:400:kworker.0 00000100:00100000:3.0:1788521345.130148:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521345.130179:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368107392:0@lo:400:kworker.0 00000100:00100000:3.0:1788521345.130200:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521345.130220:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521345.130225:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368107264:0@lo:400:kworker.0 00000100:00100000:3.0:1788521345.130248:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521345.130292:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107008 00000100:00100000:3.0:1788521345.130297:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107008 00000100:00100000:3.0:1788521345.130328:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107136 00000100:00100000:3.0:1788521345.130343:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107136 00000100:00100000:3.0:1788521345.130364:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107392 00000100:00100000:3.0:1788521345.130367:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107392 00000100:00100000:3.0:1788521345.130383:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521345.130391:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368107008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521345.130429:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368107008:12345-0@lo:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521345.130437:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521345.130451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521345.130457:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368107136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521345.130482:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368107136:12345-0@lo:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521345.130488:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521345.130501:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788521345.130508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368107392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521345.130537:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368107392:12345-0@lo:400:kworker.0 Request processed in 30us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521345.130543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788521345.130589:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368107392:0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.130722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368106880 00000100:00100000:2.0:1788521345.130727:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368106880 00000100:00100000:2.0:1788521345.130763:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788521345.130794:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368106880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.130831:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368106880:12345-0@lo:400:kworker.0 Request processed in 62us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521345.130837:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788521345.130864:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107264 00000100:00100000:2.0:1788521345.130867:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107264 00000100:00100000:2.0:1788521345.130892:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788521345.130899:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368107264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.130928:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368107264:12345-0@lo:400:kworker.0 Request processed in 29us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521345.130934:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788521345.130949:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521345.130952:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521345.130970:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368107136:0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.130979:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368107008:0@lo:400:kworker.0 00010000:00080000:2.0:1788521345.131001:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45631c00 x1875400368107264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521345.131010:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368107264:0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.131017:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368106880:0@lo:400:kworker.0 00000100:00100000:2.0:1788521345.135735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521345.135823:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521345.135909:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051712 00000100:00100000:0.0:1788521345.135920:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051712 00000100:00100000:0.0:1788521345.135982:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:0.0:1788521345.135992:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2347:x1875400346051712:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521345.136073:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2347:x1875400346051712:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521345.136081:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:3.0:1788521345.136751:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051840 00000100:00100000:3.0:1788521345.136758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051840 00000100:00100000:3.0:1788521345.136846:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1788521345.136855:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346051840:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521345.136903:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346051840:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 50us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521345.136923:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00080000:0.0:1788521345.137640:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788521346.030031:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521346.036388:0:10129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:29:04 (1788521344) === 00000100:00100000:2.0:1788521346.685735:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521346.685938:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346051968 00000100:00100000:3.0:1788521346.685947:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346051968 00000100:00100000:3.0:1788521346.686009:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:3.0:1788521346.686022:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:8113:x1875400346051968:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521346.686040:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521346.686056:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0800/0x53df1cebae0163db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440290 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.686083:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0800/0x53df1cebae0163db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440290 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.686094:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a0800/0x53df1cebae0163db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440290 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521346.686113:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0800, rc 0) 00000100:00100000:3.0:1788521346.686170:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8113:x1875400346051968:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 149us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.686176:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:3.0:1788521346.699002:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.699116:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052096 00000100:00100000:2.0:1788521346.699126:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052096 00000100:00100000:2.0:1788521346.699179:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:2.0:1788521346.699188:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8113:x1875400346052096:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521346.699489:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8113:x1875400346052096:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 301us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.699497:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:1.0:1788521346.703405:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521346.703512:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052224 00000100:00100000:0.0:1788521346.703523:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052224 00000100:00100000:0.0:1788521346.703572:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:0.0:1788521346.703582:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8113:x1875400346052224:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788521346.703830:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8113:x1875400346052224:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 249us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.703838:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:0.0:1788521346.716691:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.718146:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052352 00000100:00100000:2.0:1788521346.718161:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052352 00000100:00100000:2.0:1788521346.718351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:2.0:1788521346.718363:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8118:x1875400346052352:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521346.720496:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8118:x1875400346052352:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 2116us (3795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.720510:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:2.0:1788521346.764141:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521346.764306:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052480 00000100:00100000:3.0:1788521346.764316:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052480 00000100:00100000:3.0:1788521346.764379:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:3.0:1788521346.764387:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8118:x1875400346052480:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521346.764643:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8118:x1875400346052480:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 255us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.764657:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:1.0:1788521346.768982:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.769399:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052608 00000100:00100000:2.0:1788521346.769410:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052608 00000100:00100000:2.0:1788521346.769501:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:2.0:1788521346.769511:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:8113:x1875400346052608:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521346.769526:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521346.769541:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81beac00/0x53df1cebae0163e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a64402ba expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.769629:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beac00/0x53df1cebae0163e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402ba expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.769646:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81beac00/0x53df1cebae0163e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402ba expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.769692:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beac00, rc 0) 00000100:00100000:2.0:1788521346.769906:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:8113:x1875400346052608:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 396us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.769929:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:2.0:1788521346.777146:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521346.777231:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052736 00000100:00100000:0.0:1788521346.777241:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052736 00000100:00100000:0.0:1788521346.777288:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:0.0:1788521346.777295:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:8113:x1875400346052736:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788521346.777315:0:5828:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788521346.777437:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788521346.777440:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788521346.777446:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788521346.777448:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788521346.781959:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:8113:x1875400346052736:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 4651us (4810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.781974:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:1.0:1788521346.789146:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.789470:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052864 00000100:00100000:2.0:1788521346.789481:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052864 00000100:00100000:2.0:1788521346.789539:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:2.0:1788521346.789550:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:8113:x1875400346052864:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521346.789566:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521346.789585:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a64402c1 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.789617:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.789629:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521346.789654:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb400, rc 0) 00000100:00100000:2.0:1788521346.789762:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8113:x1875400346052864:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 213us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.789769:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:0.0:1788521346.797996:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.798112:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346052992 00000100:00100000:2.0:1788521346.798123:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346052992 00000100:00100000:2.0:1788521346.798180:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:2.0:1788521346.798190:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8113:x1875400346052992:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521346.799702:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8113:x1875400346052992:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 1508us (1710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.799714:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:0.0:1788521346.803885:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521346.804009:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053120 00000100:00100000:3.0:1788521346.804019:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053120 00000100:00100000:3.0:1788521346.804077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:3.0:1788521346.804087:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8113:x1875400346053120:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788521346.804652:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8113:x1875400346053120:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 564us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.804661:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:1.0:1788521346.819621:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.819969:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053248 00000100:00100000:2.0:1788521346.819979:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053248 00000100:00100000:2.0:1788521346.820044:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:2.0:1788521346.820054:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8120:x1875400346053248:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521346.820484:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8120:x1875400346053248:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 431us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.820493:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:0.0:1788521346.832241:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521346.835630:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053376 00000100:00100000:3.0:1788521346.835645:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053376 00000100:00100000:3.0:1788521346.835721:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:3.0:1788521346.835731:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8120:x1875400346053376:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521346.836815:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:8120:x1875400346053376:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 1079us (4577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.836827:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:1.0:1788521346.847961:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521346.848076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521346.848243:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053504 00000100:00100000:0.0:1788521346.848254:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053504 00000100:00100000:0.0:1788521346.848347:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053888 00000100:00100000:0.0:1788521346.848351:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053888 00000100:00100000:3.0:1788521346.848402:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:3.0:1788521346.848415:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346053888:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521346.848596:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346053888:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 183us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.848621:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:3.0:1788521346.848642:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1788521346.848647:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2344:x1875400346053504:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788521346.848668:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 22124939-1de7-45f1-ae59-b0320dc01898@192.168.203.48@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1788521346.848708:0:5834:0:(genops.c:1385:class_connect()) connect: client 22124939-1de7-45f1-ae59-b0320dc01898, cookie 0x53df1cebae0163f0 00000004:00100000:3.0:1788521346.848737:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788521346.849023:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8c0a81c02000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521346.849066:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+6:2344:x1875400346053504:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 417us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.849073:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1788521346.870119:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.870254:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053632 00000100:00100000:2.0:1788521346.870264:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053632 00000100:00100000:2.0:1788521346.870345:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1788521346.870372:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:0:x1875400346053632:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788521346.870418:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788521346.870525:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:0:x1875400346053632:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 155us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.870539:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00080000:0.0:1788521346.871234:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521346.874075:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521346.874263:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346053760 00000100:00100000:0.0:1788521346.874273:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346053760 00000100:00100000:0.0:1788521346.874336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1788521346.874347:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+6:8113:x1875400346053760:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521346.874377:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521346.874454:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+6:8113:x1875400346053760:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521346.874461:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1788521346.894665:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.894803:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054016 00000100:00100000:2.0:1788521346.894811:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054016 00000100:00100000:2.0:1788521346.894870:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1788521346.894880:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:8113:x1875400346054016:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788521346.894972:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:8113:x1875400346054016:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 93us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.894981:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1788521346.901893:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521346.902008:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521346.902122:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521346.902185:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054400 00000100:00100000:2.0:1788521346.902196:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054400 00000100:00100000:2.0:1788521346.902256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1788521346.902268:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:8113:x1875400346054400:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788521346.902344:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788521346.902425:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:8113:x1875400346054400:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 159us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.902433:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1788521346.912359:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054144 00000100:00100000:3.0:1788521346.912376:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054144 00000100:00100000:3.0:1788521346.912486:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054272 00000100:00100000:3.0:1788521346.912490:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054272 00000100:00100000:3.0:1788521346.912511:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1788521346.912519:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875400346054144:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788521346.912549:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 22124939-1de7-45f1-ae59-b0320dc01898@192.168.203.48@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1788521346.912591:0:6692:0:(genops.c:1385:class_connect()) connect: client 22124939-1de7-45f1-ae59-b0320dc01898, cookie 0x53df1cebae0163f7 00000100:00100000:2.0:1788521346.912746:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1788521346.912752:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1875400346054272:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788521346.912770:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 22124939-1de7-45f1-ae59-b0320dc01898@192.168.203.48@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1788521346.912810:0:6693:0:(genops.c:1385:class_connect()) connect: client 22124939-1de7-45f1-ae59-b0320dc01898, cookie 0x53df1cebae0163fe 00002000:00100000:3.0:1788521346.913044:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 22124939-1de7-45f1-ae59-b0320dc01898/ffff8c0a81c02800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788521346.913068:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788521346.913298:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 22124939-1de7-45f1-ae59-b0320dc01898/ffff8c0a7c4d2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521346.913306:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521346.913503:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521346.913574:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8c0a7c4d7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521346.913680:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22124939-1de7-45f1-ae59-b0320dc01898+6:2344:x1875400346054272:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 927us (11558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521346.913689:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00002000:00080000:3.0:1788521346.915884:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521346.915920:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8c0a81c03000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521346.916123:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+6:2344:x1875400346054144:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 3600us (14111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521346.916133:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00010000:00010000:1.0:1788521347.049164:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521348.077500:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521348.721762:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521348.721894:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368107520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521348.721957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521348.722018:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107520 00000100:00100000:1.0:1788521348.722025:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107520 00000100:00100000:1.0:1788521348.722075:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521348.722098:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368107520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521348.722132:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521348.722198:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368107520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521348.722205:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788521348.722241:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e218000 x1875400368107520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521348.722266:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368107520:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521348.722850:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788521348.791898:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22124939-1de7-45f1-ae59-b0320dc01898 00010000:00010000:3.0:1788521349.097104:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788521349.286028:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22124939-1de7-45f1-ae59-b0320dc01898 00010000:00010000:0.0:1788521350.123181:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521350.249736:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521350.249757:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368107648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521350.249856:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521350.249913:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107648 00000100:00100000:0.0:1788521350.249920:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107648 00000100:00100000:0.0:1788521350.249972:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521350.249980:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368107648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521350.250012:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521350.250061:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368107648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521350.250067:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788521350.250099:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788521350.250127:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e218000 x1875400368107648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521350.250146:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368107648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521350.250527:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368108160:0@lo:400:kworker.0 00000100:00100000:1.0:1788521350.250567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521350.250592:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521350.250597:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368108032:0@lo:400:kworker.0 00000100:00100000:1.0:1788521350.250621:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521350.250644:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108160 00000100:00100000:1.0:1788521350.250648:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108160 00000100:00100000:1.0:1788521350.250681:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521350.250688:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368108160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521350.250725:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368108160:12345-0@lo:400:kworker.0 Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521350.250732:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788521350.250760:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e21aa00 x1875400368108160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521350.250770:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368108160:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.250967:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368107776:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.250996:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521350.251018:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368108288:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251034:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521350.251051:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521350.251055:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368107904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251082:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521350.251112:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108032 00000100:00100000:0.0:1788521350.251116:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108032 00000100:00100000:0.0:1788521350.251143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108288 00000100:00100000:0.0:1788521350.251146:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108288 00000100:00100000:0.0:1788521350.251158:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107904 00000100:00100000:0.0:1788521350.251159:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107904 00000100:00100000:0.0:1788521350.251169:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521350.251174:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368108032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251207:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368108032:12345-0@lo:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521350.251212:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521350.251235:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788521350.251242:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368108288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251281:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368108288:12345-0@lo:400:kworker.0 Request processed in 40us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521350.251287:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788521350.251300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521350.251306:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368107904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251331:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368107904:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521350.251336:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521350.251353:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368107776 00000100:00100000:0.0:1788521350.251356:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368107776 00000100:00100000:0.0:1788521350.251390:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788521350.251397:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368107776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251423:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368107776:12345-0@lo:400:kworker.0 Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521350.251428:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:0.0:1788521350.251461:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521350.251465:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521350.251482:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368107904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251490:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368107776:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251498:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e219500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368108288:0@lo:400:kworker.0 00000100:00100000:0.0:1788521350.251526:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368108032:0@lo:400:kworker.0 00000001:00100000:1.0:1788521350.843444:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22124939-1de7-45f1-ae59-b0320dc01898 00010000:00010000:3.0:1788521351.148614:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521352.168989:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521352.306111:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521352.306558:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521352.306598:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521352.306625:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521352.306658:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054528 00000100:00100000:0.0:1788521352.306667:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054528 00000100:00100000:0.0:1788521352.306711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:0.0:1788521352.306731:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346054528:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521352.306821:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346054528:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 91us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521352.306828:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:3.0:1788521352.307090:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054912 00000100:00100000:3.0:1788521352.307095:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054912 00000100:00100000:3.0:1788521352.307142:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1788521352.307149:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346054912:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521352.307185:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346054912:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521352.307201:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00080000:0.0:1788521352.307250:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521352.307465:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521352.307507:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055040 00000100:00100000:1.0:1788521352.307511:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055040 00000100:00100000:1.0:1788521352.307541:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1788521352.307548:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346055040:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521352.307838:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346055040:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 289us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521352.307855:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00080000:1.0:1788521352.308654:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521352.312104:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054656 00000100:00100000:2.0:1788521352.312118:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054656 00000100:00100000:2.0:1788521352.312200:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346054784 00000100:00100000:2.0:1788521352.312203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346054784 00000100:00080000:1.0:1788521352.312276:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521352.312441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:2.0:1788521352.312450:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346054656:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521352.312524:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346054656:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 75us (6422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521352.312532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:2.0:1788521352.312549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:2.0:1788521352.312555:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346054784:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521352.312644:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346054784:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 88us (6017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521352.312650:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00080000:1.0:1788521352.313009:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788521352.742306:0:10328:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788521353.194974:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521353.833793:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368108416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521353.833897:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521353.837452:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108416 00000100:00100000:0.0:1788521353.837476:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108416 00000100:00100000:0.0:1788521353.837595:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521353.837606:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368108416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521353.837657:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521353.837763:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368108416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (3874us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521353.837771:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788521353.837872:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6e21b100 x1875400368108416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521353.837909:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368108416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788521353.839644:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521354.224068:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521355.242262:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521355.370887:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368108800:0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.370953:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521355.371009:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521355.371016:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368108928:0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.371055:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521355.371094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108800 00000100:00100000:3.0:1788521355.371101:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108800 00000100:00100000:3.0:1788521355.371156:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521355.371166:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368108800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.371214:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368108800:12345-0@lo:400:kworker.0 Request processed in 50us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521355.371221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788521355.371245:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108928 00000100:00100000:3.0:1788521355.371249:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108928 00000100:00100000:3.0:1788521355.371277:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788521355.371283:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368108928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.371311:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368108928:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521355.371317:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788521355.371332:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521355.371336:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521355.371361:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d17b80 x1875400368108928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521355.371385:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368108928:0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.371398:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368108800:0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371474:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368108544:0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521355.371538:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368109056:0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371561:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521355.371580:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521355.371585:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368108672:0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521355.371644:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521355.371699:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109056 00000100:00100000:1.0:1788521355.371704:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109056 00000100:00100000:1.0:1788521355.371735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108672 00000100:00100000:1.0:1788521355.371738:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108672 00000100:00100000:1.0:1788521355.371755:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788521355.371761:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368109056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371817:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368109056:12345-0@lo:400:kworker.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521355.371824:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788521355.371840:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788521355.371845:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368108672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371870:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368108672:12345-0@lo:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521355.371883:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788521355.371910:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109184 00000100:00100000:1.0:1788521355.371914:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109184 00000100:00100000:1.0:1788521355.371938:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788521355.371945:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368109184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.371975:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368109184:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521355.371980:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788521355.371996:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521355.371999:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521355.372017:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368108672:0@lo:400:kworker.0 00010000:00080000:1.0:1788521355.372026:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5df80 x1875400368109184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521355.372034:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788521355.372054:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368109056:0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.372311:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368108544 00000100:00100000:3.0:1788521355.372315:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368108544 00000100:00100000:3.0:1788521355.372352:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788521355.372358:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368108544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521355.372394:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368108544:12345-0@lo:400:kworker.0 Request processed in 36us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521355.372399:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788521355.372466:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368108544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521355.373321:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521355.373334:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368109312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521355.373373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521355.373406:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109312 00000100:00100000:2.0:1788521355.373410:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109312 00000100:00100000:2.0:1788521355.373441:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788521355.373448:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368109312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521355.373476:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521355.373512:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368109312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521355.373518:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788521355.373548:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a81da6a00 x1875400368109312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521355.373564:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368109312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521356.264902:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521357.292493:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521357.423474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521357.423534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521357.423565:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521357.423587:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521357.423612:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521357.423647:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055552 00000100:00100000:2.0:1788521357.423659:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055552 00000100:00100000:2.0:1788521357.423729:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055680 00000100:00100000:2.0:1788521357.423732:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055680 00000100:00100000:2.0:1788521357.423759:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:2.0:1788521357.423932:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346055552:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521357.424044:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346055552:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 275us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.424053:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:2.0:1788521357.424073:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:2.0:1788521357.424080:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346055680:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521357.424105:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346055680:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.424111:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:2.0:1788521357.424133:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055168 00000100:00100000:2.0:1788521357.424136:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055168 00000100:00100000:2.0:1788521357.424163:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:2.0:1788521357.424169:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346055168:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521357.424194:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346055168:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.424200:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:2.0:1788521357.424229:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055296 00000100:00100000:2.0:1788521357.424233:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055296 00000100:00100000:2.0:1788521357.424258:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055424 00000100:00100000:2.0:1788521357.424261:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055424 00000100:00100000:2.0:1788521357.424281:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:2.0:1788521357.424287:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346055296:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521357.424315:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346055296:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.424322:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:2.0:1788521357.424334:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:2.0:1788521357.424347:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346055424:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521357.424371:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346055424:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521357.424377:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00080000:2.0:1788521357.424399:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521357.424405:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521357.424407:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521358.317318:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521358.953239:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368109440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521358.953312:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521358.953730:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109440 00000100:00100000:3.0:1788521358.953740:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109440 00000100:00100000:3.0:1788521358.953819:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788521358.953830:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368109440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521358.953862:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788521358.954098:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521358.960496:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368109440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6657us (7172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521358.960513:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788521358.965946:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a46418000 x1875400368109440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521358.965974:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368109440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521359.337049:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521360.360880:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521360.489236:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521360.492667:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368109696:0@lo:400:kworker.0 00000100:00100000:0.0:1788521360.492748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521360.492823:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368109568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521360.492850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521360.493039:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109696 00000100:00100000:1.0:1788521360.493048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109696 00000100:00100000:1.0:1788521360.493107:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788521360.493117:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368109696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521360.493165:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368109696:12345-0@lo:400:kworker.0 Request processed in 50us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521360.493172:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788521360.494375:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368110080:0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.494402:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368109952:0@lo:400:kworker.0 00000100:00100000:1.0:1788521360.494435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521360.494447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521360.494487:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521360.494494:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368109824:0@lo:400:kworker.0 00000100:00100000:0.0:1788521360.494569:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368110208:0@lo:400:kworker.0 00000100:00100000:3.0:1788521360.494594:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110080 00000100:00100000:3.0:1788521360.494600:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110080 00000100:00100000:3.0:1788521360.494642:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788521360.494649:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368110080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.495715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521360.495759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109952 00000100:00100000:2.0:1788521360.495764:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109952 00000100:00100000:2.0:1788521360.497115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109824 00000100:00100000:2.0:1788521360.497123:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109824 00000100:00100000:2.0:1788521360.497157:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521360.497166:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368109952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.497240:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368109952:12345-0@lo:400:kworker.0 Request processed in 76us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521360.497260:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788521360.497279:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788521360.497285:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368109824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.497316:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368109824:12345-0@lo:400:kworker.0 Request processed in 31us (1605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521360.497322:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788521360.497375:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368109824:0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.497387:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368109952:0@lo:400:kworker.0 00000100:00100000:1.0:1788521360.497841:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368109568 00000100:00100000:1.0:1788521360.497847:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368109568 00000100:00100000:1.0:1788521360.497885:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521360.497892:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368109568:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521360.497972:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788521360.497985:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521360.498022:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368109696:0@lo:400:kworker.0 00000100:00100000:1.0:1788521360.498033:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368109568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (5183us total) trans 0 rc 0/0 00010000:00080000:0.0:1788521360.498036:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f7b7800 x1875400368109568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521360.498040:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521360.498051:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368109568:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788521360.498075:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521360.498515:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521360.498518:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521360.498633:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368110080:12345-0@lo:400:kworker.0 Request processed in 3982us (4196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521360.498650:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788521360.498682:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5d180 x1875400368110080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521360.498693:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368110080:0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.503690:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110208 00000100:00100000:2.0:1788521360.503706:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110208 00000100:00100000:2.0:1788521360.503790:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788521360.503802:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368110208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521360.503905:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368110208:12345-0@lo:400:kworker.0 Request processed in 107us (5933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521360.503923:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788521360.503973:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368110208:0@lo:400:kworker.0 00000100:00080000:0.0:1788521360.504262:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521361.391194:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521362.408878:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521362.541077:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521362.541113:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521362.541142:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055936 00000100:00100000:3.0:1788521362.541150:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055936 00000100:00100000:3.0:1788521362.541210:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:3.0:1788521362.541221:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346055936:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521362.541292:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346055936:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 73us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.541300:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:3.0:1788521362.541324:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056192 00000100:00100000:3.0:1788521362.541328:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056192 00000100:00100000:3.0:1788521362.541356:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1788521362.541363:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056192:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521362.541389:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056192:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.541396:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00080000:3.0:1788521362.541469:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521362.541474:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521362.541507:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521362.541563:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521362.541661:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521362.541681:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056320 00000100:00100000:3.0:1788521362.541685:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056320 00000100:00100000:3.0:1788521362.541714:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1788521362.541721:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056320:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521362.541752:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056320:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.541758:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1788521362.541807:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346055808 00000100:00100000:3.0:1788521362.541811:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346055808 00000100:00100000:3.0:1788521362.541835:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:3.0:1788521362.541841:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346055808:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521362.541868:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346055808:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.541874:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:3.0:1788521362.541896:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056064 00000100:00100000:3.0:1788521362.541900:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056064 00000100:00100000:3.0:1788521362.541927:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1788521362.541933:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056064:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521362.541957:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056064:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521362.541963:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00080000:3.0:1788521362.541998:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521362.542001:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788521363.437527:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521364.073994:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521364.074031:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368110336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521364.074104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521364.074188:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110336 00000100:00100000:3.0:1788521364.074196:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110336 00000100:00100000:3.0:1788521364.074262:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788521364.074275:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368110336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521364.074313:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521364.074367:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368110336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521364.074375:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788521364.074402:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521364.074442:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5ce00 x1875400368110336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521364.074461:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368110336:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521364.457860:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521365.481197:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521365.609020:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368110848:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609086:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.609141:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521365.609148:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368110464:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609173:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.609196:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368110976:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609227:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.609252:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368110592:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.609290:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368111104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609314:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.609331:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521365.609337:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368110720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609356:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521365.609385:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110848 00000100:00100000:0.0:1788521365.609392:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110848 00000100:00100000:0.0:1788521365.609430:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111104 00000100:00100000:0.0:1788521365.609433:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111104 00000100:00100000:0.0:1788521365.609473:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521365.609496:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368110848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609546:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368110848:12345-0@lo:400:kworker.0 Request processed in 63us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.609553:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521365.609568:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521365.609573:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368111104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.609604:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfe8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368111104:12345-0@lo:400:kworker.0 Request processed in 31us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.609610:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788521365.609798:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110464 00000100:00100000:0.0:1788521365.609803:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110464 00000100:00100000:0.0:1788521365.610100:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788521365.610111:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368110464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610144:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368110464:12345-0@lo:400:kworker.0 Request processed in 36us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.610150:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788521365.610179:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110976 00000100:00100000:0.0:1788521365.610183:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110976 00000100:00100000:0.0:1788521365.610216:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110592 00000100:00100000:0.0:1788521365.610219:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110592 00000100:00100000:0.0:1788521365.610231:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368110720 00000100:00100000:0.0:1788521365.610233:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368110720 00000100:00100000:0.0:1788521365.610248:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521365.610254:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368110976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610284:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368110976:12345-0@lo:400:kworker.0 Request processed in 30us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.610301:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788521365.610314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521365.610319:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368110592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610346:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368110592:12345-0@lo:400:kworker.0 Request processed in 27us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.610351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788521365.610361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521365.610366:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368110720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610387:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368110720:12345-0@lo:400:kworker.0 Request processed in 21us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521365.610392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788521365.610420:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521365.610424:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521365.610452:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368110720:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610461:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368110592:0@lo:400:kworker.0 00010000:00080000:0.0:1788521365.610472:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45630e00 x1875400368111104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521365.610492:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368111104:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610525:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368110464:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.610534:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45630a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368110976:0@lo:400:kworker.0 00010000:00080000:0.0:1788521365.610544:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45632680 x1875400368110848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521365.610552:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45632680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368110848:0@lo:400:kworker.0 00000100:00100000:0.0:1788521365.611241:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368111232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521365.611280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521365.611354:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111232 00000100:00100000:3.0:1788521365.611360:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111232 00000100:00100000:3.0:1788521365.611399:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788521365.611407:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368111232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521365.611435:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521365.611484:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368111232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521365.611491:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788521365.611577:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a46419f80 x1875400368111232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521365.611591:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46419f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368111232:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788521366.507683:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521367.535289:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521367.664077:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521367.664382:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056832 00000100:00100000:0.0:1788521367.664392:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056832 00000100:00100000:0.0:1788521367.664466:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521367.664478:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2344:x1875400346056832:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:0.0:1788521367.664505:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0163f7 00000100:00080000:0.0:1788521367.664514:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a81c03000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788521367.664544:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788521367.664554:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788521367.664754:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521367.665579:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:22124939-1de7-45f1-ae59-b0320dc01898+2:2344:x1875400346056832:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 1099us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521367.665591:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1788521367.670434:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521367.670494:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521367.670534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521367.670564:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521367.670591:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056704 00000100:00100000:1.0:1788521367.670601:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056704 00000100:00100000:1.0:1788521367.670655:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056576 00000100:00100000:1.0:1788521367.670658:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056576 00000100:00100000:1.0:1788521367.670679:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:1.0:1788521367.670688:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056704:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521367.670749:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:1.0:1788521367.670758:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346056704:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521367.670764:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346056576:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521367.670795:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:2.0:1788521367.670822:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346056576:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 63us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521367.670831:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:1.0:1788521367.670833:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056960 00000100:00100000:1.0:1788521367.670838:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056960 00000100:00100000:1.0:1788521367.670874:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1788521367.671024:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2344:x1875400346056960:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:1.0:1788521367.671045:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0163fe 00000100:00080000:1.0:1788521367.671055:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8c0a7c4d7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788521367.671102:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788521367.671134:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521367.671546:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:22124939-1de7-45f1-ae59-b0320dc01898+2:2344:x1875400346056960:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 524us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521367.671553:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1788521367.671864:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346056448 00000100:00100000:3.0:1788521367.671870:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346056448 00000100:00100000:3.0:1788521367.671981:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:3.0:1788521367.671990:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346056448:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521367.672024:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346056448:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521367.672030:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00080000:3.0:1788521367.672062:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521367.672067:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521368.552991:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521369.193147:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368111360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521369.193250:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521369.193385:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111360 00000100:00100000:1.0:1788521369.193397:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111360 00000100:00100000:1.0:1788521369.193488:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521369.193500:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368111360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521369.193544:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521369.193730:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521369.199129:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368111360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5614us (5861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521369.199149:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788521369.203709:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5d500 x1875400368111360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521369.203828:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368111360:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788521369.277513:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 22124939-1de7-45f1-ae59-b0320dc01898 00000020:00000080:3.0:1788521369.277523:0:7652:0:(genops.c:885:class_export_put()) final put ffff8c0a7c4d2800/22124939-1de7-45f1-ae59-b0320dc01898 00000020:00000080:1.0:1788521369.277595:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7c4d2800/22124939-1de7-45f1-ae59-b0320dc01898 for lustre-OST0001 00000020:00000080:1.0:1788521369.277646:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7c4d7800 for lustre-OST0001 00010000:00010000:2.0:1788521369.576934:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521370.426870:0:11030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788521370.609176:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521370.729009:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368111872:0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.729077:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521370.729158:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788521370.729164:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368111744:0@lo:400:kworker.0 00000100:00100000:2.0:1788521370.729165:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368112000:0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.729187:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521370.729191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521370.729206:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368112256:0@lo:400:kworker.0 00000100:00100000:2.0:1788521370.729213:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788521370.729218:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368111616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521370.729240:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521370.729241:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521370.729261:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368111488:0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.729277:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111872 00000100:00100000:2.0:1788521370.729284:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521370.729285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111872 00000100:00100000:2.0:1788521370.729304:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368112128:0@lo:400:kworker.0 00000100:00100000:2.0:1788521370.729322:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521370.729426:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111488 00000100:00100000:3.0:1788521370.729432:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111488 00000100:00100000:3.0:1788521370.729463:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788521370.729472:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368111488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521370.729520:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368111488:12345-0@lo:400:kworker.0 Request processed in 49us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521370.729527:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788521370.731402:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111744 00000100:00100000:1.0:1788521370.731414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111744 00000100:00100000:1.0:1788521370.731464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368112128 00000100:00100000:1.0:1788521370.731467:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368112128 00000100:00100000:1.0:1788521370.731503:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788521370.731513:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368111872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.731582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368111872:12345-0@lo:400:kworker.0 Request processed in 70us (2503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521370.731589:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788521370.731606:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788521370.731612:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368111744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.731640:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368111744:12345-0@lo:400:kworker.0 Request processed in 29us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521370.731647:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788521370.731659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788521370.731665:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368112128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.731690:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368112128:12345-0@lo:400:kworker.0 Request processed in 26us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521370.731696:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788521370.731721:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368112000 00000100:00100000:1.0:1788521370.731725:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368112000 00000100:00100000:1.0:1788521370.731751:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368112256 00000100:00100000:1.0:1788521370.731754:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368112256 00000100:00100000:1.0:1788521370.731788:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521370.731795:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368112000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.732455:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368112000:12345-0@lo:400:kworker.0 Request processed in 49us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521370.732465:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521370.732482:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521370.732542:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368112128:0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.732554:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368112256:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788521370.732563:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45633b80 x1875400368112000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521370.732595:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368112256:12345-0@lo:400:kworker.0 Request processed in 47us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521370.732601:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521370.732621:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368111616 00000100:00100000:1.0:1788521370.732625:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368111616 00000100:00100000:1.0:1788521370.732652:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788521370.732658:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368111616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521370.732684:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521370.732688:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45633b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368112000:0@lo:400:kworker.0 00000100:00100000:1.0:1788521370.732728:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368111616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (3485us total) trans 0 rc 0/0 00010000:00080000:3.0:1788521370.732730:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a46418700 x1875400368111616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521370.732740:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788521370.732762:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521370.732768:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521370.732795:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368111616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521370.732814:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368111488:0@lo:400:kworker.0 00000100:00100000:2.0:1788521370.732922:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45630e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368111744:0@lo:400:kworker.0 00010000:00080000:2.0:1788521370.733011:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45630000 x1875400368112256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521370.733022:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45630000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368112256:0@lo:400:kworker.0 00000100:00100000:2.0:1788521370.733034:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45633480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368111872:0@lo:400:kworker.0 00000001:00100000:0.0:1788521371.320507:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 22124939-1de7-45f1-ae59-b0320dc01898 00000020:00000080:0.0:1788521371.320516:0:6716:0:(genops.c:885:class_export_put()) final put ffff8c0a81c02800/22124939-1de7-45f1-ae59-b0320dc01898 00000020:00000080:0.0:1788521371.320539:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a81c02800/22124939-1de7-45f1-ae59-b0320dc01898 for lustre-OST0000 00000020:00000080:0.0:1788521371.320711:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a81c03000 for lustre-OST0000 00010000:00010000:2.0:1788521371.625603:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521372.648972:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521372.781942:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521372.781987:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521372.782023:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521372.782244:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057344 00000100:00100000:0.0:1788521372.782253:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057344 00000100:00100000:0.0:1788521372.782316:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057216 00000100:00100000:0.0:1788521372.782318:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057216 00000100:00100000:0.0:1788521372.782362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1788521372.782370:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346057344:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521372.782433:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346057344:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 64us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521372.782439:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1788521372.782454:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:0.0:1788521372.782460:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346057216:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521372.782478:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346057216:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 19us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521372.782483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:1.0:1788521372.782602:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057088 00000100:00100000:1.0:1788521372.782606:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057088 00000100:00100000:1.0:1788521372.782640:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:1.0:1788521372.782647:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346057088:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521372.782673:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346057088:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521372.782678:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00080000:3.0:1788521372.783251:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788521373.580249:0:11178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc265ae9f0 20000000:00000080:2.0:1788521373.580265:0:11178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c0a75ca0800 uarg=0000000000000000 20000000:01000000:2.0:1788521373.580304:0:11178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521373.580310:0:11178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788521373.580314:0:11178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788521373.581184:0:11179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788521373.581339:0:11178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788521373.587492:0:11178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788521373.587524:0:11178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587557:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587566:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587573:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0163bf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587580:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0163cd expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587587:0:11178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587594:0:11178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587637:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587651:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 12 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521373.587666:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f259180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112384:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521373.587803:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0163cd expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587814:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0163cd expref: 18 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521373.587834:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112512:0@lo:104: 00000100:00100000:2.0:1788521373.587873:0:11178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521373.587926:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0163bf expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587934:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0163bf expref: 18 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521373.587941:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112640:0@lo:104: 00000100:00100000:2.0:1788521373.587957:0:11178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521373.587973:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.587980:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 18 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521373.587986:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f258e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112768:0@lo:104: 00000100:00100000:2.0:1788521373.588000:0:11178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788521373.588022:0:11178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521373.588041:0:11178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 12 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521373.588049:0:11178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f259500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112896:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521373.588069:0:11178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521373.588685:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368112512 00000100:00100000:3.0:1788521373.588693:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368112512 00000100:00100000:3.0:1788521373.588726:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368112640 00000100:00100000:3.0:1788521373.588728:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368112640 00000100:00100000:3.0:1788521373.588737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368112768 00000100:00100000:3.0:1788521373.588739:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368112768 00000100:00100000:3.0:1788521373.588752:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521373.588760:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:11178:x1875400368112512:12345-0@lo:104: 00010000:00010000:3.0:1788521373.588800:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.588857:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521373.588863:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+5:11178:x1875400368112512:12345-0@lo:104: Request processed in 104us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.588869:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788521373.588884:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521373.588890:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:11178:x1875400368112640:12345-0@lo:104: 00010000:00010000:3.0:1788521373.589160:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589198:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521373.589216:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:11178:x1875400368112640:12345-0@lo:104: Request processed in 326us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.589222:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788521373.589235:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788521373.589241:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:11178:x1875400368112768:12345-0@lo:104: 00010000:00010000:3.0:1788521373.589249:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589276:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521373.589280:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:11178:x1875400368112768:12345-0@lo:104: Request processed in 40us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.589285:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788521373.589300:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521373.589305:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589311:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb800 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521373.589315:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589322:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521373.589327:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521373.589332:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521373.589360:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589444:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521373.589464:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589471:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae0163cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163d4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589484:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521373.589487:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589491:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521373.589494:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589500:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521373.589505:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521373.589510:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521373.589522:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589527:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521373.589539:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589545:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1200/0x53df1cebae0163bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163c6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589560:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521373.589563:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589569:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea600 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521373.589572:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589579:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521373.589585:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521373.589589:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521373.589603:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589609:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521373.589615:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a81bea600/0x53df1cebae0163b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0163b8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.589632:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521373.589634:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521373.589635:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521373.589642:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521373.589667:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368113024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521373.589701:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521373.589747:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368113152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521373.589770:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521373.591617:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521373.591628:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368113280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521373.591671:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521373.591710:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113024 00000100:00100000:3.0:1788521373.591718:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113024 00010000:00010000:3.0:1788521373.591750:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0163cd expref: 19 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521373.591798:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113152 00000100:00100000:3.0:1788521373.591802:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113152 00010000:00010000:3.0:1788521373.591816:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0163bf expref: 20 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521373.591826:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113280 00000100:00100000:3.0:1788521373.591828:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113280 00010000:00010000:3.0:1788521373.591837:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 21 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521373.591849:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521373.591856:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02b855e8-b82d-4a25-90ff-ed0c016d947b+21:3303:x1875400368113024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521373.591866:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521373.591871:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0163cd expref: 21 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.591880:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0163cd expref: 21 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521373.592045:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112512:0@lo:104: 00000100:00100000:0.0:1788521373.592056:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112640:0@lo:104: 00000100:00100000:0.0:1788521373.592064:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f258e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112768:0@lo:104: 00010000:00010000:3.0:1788521373.592145:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166f000/0x53df1cebae0163d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0163cd expref: 21 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592159:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521373.592302:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521373.592319:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521373.592363:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46424850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3303:x1875400368113024:12345-0@lo:103:ldlm_bl.0 Request processed in 507us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.592370:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521373.592415:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057472 00000100:00100000:3.0:1788521373.592418:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057472 00010000:00010000:3.0:1788521373.592430:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 13 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521373.592439:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057600 00000100:00100000:3.0:1788521373.592441:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057600 00010000:00010000:3.0:1788521373.592449:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 14 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521373.592458:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521373.592463:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368113152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521373.592469:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521373.592472:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0163bf expref: 19 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592479:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0163bf expref: 19 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592488:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea400/0x53df1cebae0163c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0163bf expref: 19 pid: 5825 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592504:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521373.592540:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3300:x1875400368113152:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.592546:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788521373.592558:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521373.592563:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3300:x1875400368113280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521373.592569:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521373.592573:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 17 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592581:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 17 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592591:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a1e00/0x53df1cebae0163b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0163b1 expref: 17 pid: 5828 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592599:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521373.592619:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3300:x1875400368113280:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.592624:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521373.592635:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1788521373.592641:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+14:2345:x1875400346057472:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521373.592649:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521373.592653:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 14 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592663:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 14 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592679:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521373.592720:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+14:2345:x1875400346057472:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 78us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.592727:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1788521373.592739:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1788521373.592746:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346057600:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521373.592754:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521373.592758:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 13 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592766:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 13 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592801:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592810:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592823:0:8520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592830:0:8520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592837:0:8520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592844:0:8520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592856:0:8520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521373.592861:0:8520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592869:0:8520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592878:0:8520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521373.592888:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521373.593106:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346057600:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 359us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521373.593113:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:2.0:1788521373.593384:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368113280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521373.593395:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368113152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521373.593661:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beb400/0x53df1cebae0163e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402c1 expref: 12 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521373.593706:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f259180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112384:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521373.593720:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c5800/0x53df1cebae0163aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440289 expref: 11 pid: 5826 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521373.593728:0:11178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f259500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11178:1875400368112896:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521373.593751:0:11178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521373.593760:0:11178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521373.593766:0:11178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521373.593803:0:11178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beb200/0x53df1cebae016405 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521373.597639:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368113024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521373.673109:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521374.314543:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521374.314563:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368113408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521374.314625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521374.320630:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113408 00000100:00100000:3.0:1788521374.320646:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113408 00000100:00100000:3.0:1788521374.321575:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521374.321588:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368113408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521374.321627:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521374.321827:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368113408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (7200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521374.321834:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788521374.321889:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5ca80 x1875400368113408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521374.321925:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368113408:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521374.329649:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521374.697457:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521375.218240:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521375.218249:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a7f66c000 from 7 10000000:01000000:1.0:1788521375.218254:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521375.218298:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.218309:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.218329:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521375.218355:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a4641bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.218422:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521375.218484:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45276480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521375.223868:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113536 00000100:00100000:2.0:1788521375.223882:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113536 00000100:00100000:2.0:1788521375.223966:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788521375.223977:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368113536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521375.223993:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521375.224012:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01640c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.224040:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01640c expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.224059:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01640c expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.224069:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea600, rc 0) 00000100:00100000:2.0:1788521375.224254:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368113536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 279us (5831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521375.224261:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788521375.224834:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a4641bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521375.224853:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.224862:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521375.224939:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a4641bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.224972:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521375.225011:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45276480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521375.225213:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113664 00000100:00100000:2.0:1788521375.225220:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113664 00000100:00100000:2.0:1788521375.225251:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788521375.225259:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368113664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521375.228355:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368113664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3088us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521375.228379:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788521375.230886:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a4641bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.230963:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a4641bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.231038:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521375.231253:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45276480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521375.231398:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113792 00000100:00100000:3.0:1788521375.231406:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113792 00000100:00100000:3.0:1788521375.232046:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788521375.232070:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368113792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521375.232316:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368113792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 250us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.232325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788521375.232505:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a4641bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521375.233820:0:11232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788521375.233955:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788521375.233977:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521375.233988:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.233999:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521375.234009:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521375.234012:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a75d22000 from 7 10000000:01000000:2.0:1788521375.234015:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521375.234060:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.234069:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.234080:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521375.234219:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f258000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521375.234275:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521375.234319:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521375.234560:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368113920 00000100:00100000:0.0:1788521375.234568:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368113920 00000100:00100000:0.0:1788521375.234658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788521375.234669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368113920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521375.234683:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521375.234697:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01641a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.234722:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01641a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.234744:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01641a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521375.234753:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4200, rc 0) 00000100:00100000:0.0:1788521375.234841:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368113920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.234848:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788521375.235565:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f258000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368113920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521375.235585:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.235596:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521375.235723:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f258000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521375.235907:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521375.235971:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521375.236062:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114048 00000100:00100000:0.0:1788521375.236067:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114048 00000100:00100000:0.0:1788521375.236171:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788521375.236181:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368114048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521375.236451:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368114048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.236459:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788521375.238831:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f258000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521375.238909:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521375.238982:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521375.239018:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f7a3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521375.239038:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114176 00000100:00100000:3.0:1788521375.239044:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114176 00000100:00100000:3.0:1788521375.239297:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788521375.239307:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368114176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521375.239641:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368114176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.239650:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788521375.239712:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788521375.243401:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788521375.243658:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788521375.243682:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521375.243693:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521375.243705:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521375.243715:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521375.243727:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a4f90d800 from 7 10000000:01000000:3.0:1788521375.243730:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521375.243763:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521375.243770:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521375.243840:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521375.243864:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521375.243932:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521375.244001:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f7a3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521375.244036:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114304 00000100:00100000:1.0:1788521375.244049:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114304 00000100:00100000:1.0:1788521375.245025:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788521375.245037:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368114304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521375.245208:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521375.245225:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016428 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.245252:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016428 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.245262:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016428 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.245271:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166e400, rc 0) 00000100:00100000:1.0:1788521375.245374:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368114304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 338us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521375.245382:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788521375.246665:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521375.246690:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521375.246701:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521375.246982:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f259c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521375.247032:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521375.247137:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521375.247243:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114432 00000100:00100000:3.0:1788521375.247248:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114432 00000100:00100000:3.0:1788521375.247293:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788521375.247301:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368114432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521375.247633:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368114432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.247641:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788521375.247716:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f259c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521375.247748:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f259c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521375.247819:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521375.247838:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521375.247936:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114560 00000100:00100000:0.0:1788521375.247941:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114560 00000100:00100000:0.0:1788521375.247975:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788521375.247985:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368114560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521375.248154:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368114560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.248161:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788521375.248651:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f259c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368114560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788521375.252117:0:11237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788521375.253311:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788521375.253351:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521375.253363:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521375.253374:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521375.343189:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521375.343545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057728 00000100:00100000:2.0:1788521375.343631:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057728 00000100:00100000:2.0:1788521375.343694:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:2.0:1788521375.343704:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:5589:x1875400346057728:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521375.343720:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521375.343737:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a64402eb expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.343765:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.344654:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521375.344675:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea200, rc 0) 00000100:00100000:2.0:1788521375.344748:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346057728:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 1045us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521375.344757:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:0.0:1788521375.352160:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521375.353634:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057856 00000100:00100000:1.0:1788521375.353648:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057856 00000100:00100000:1.0:1788521375.353719:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:1.0:1788521375.353728:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346057856:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.354072:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346057856:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 343us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521375.354080:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:2.0:1788521375.359793:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521375.360873:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346057984 00000100:00100000:0.0:1788521375.360884:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346057984 00000100:00100000:0.0:1788521375.360951:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:0.0:1788521375.360960:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346057984:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521375.361194:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346057984:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 233us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.361201:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:2.0:1788521375.373767:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521375.380944:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058112 00000100:00100000:1.0:1788521375.380959:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058112 00000100:00100000:1.0:1788521375.381224:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 243 00000100:00100000:1.0:1788521375.381235:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346058112:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521375.381270:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521375.381289:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a64402f2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.381326:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.381338:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521375.381348:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166ec00, rc 0) 00000100:00100000:1.0:1788521375.381425:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346058112:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 191us (7666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521375.381432:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 243 00000100:00100000:2.0:1788521375.389255:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521375.389351:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058240 00000100:00100000:1.0:1788521375.389361:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058240 00000100:00100000:1.0:1788521375.389407:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:1.0:1788521375.389417:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346058240:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.389808:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346058240:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 390us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521375.389816:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:2.0:1788521375.401039:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521375.401238:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058368 00000100:00100000:1.0:1788521375.401249:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058368 00000100:00100000:1.0:1788521375.401310:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 245 00000100:00100000:1.0:1788521375.401320:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346058368:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521375.401550:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346058368:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 229us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521375.401566:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 245 00010000:00010000:1.0:1788521375.723770:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521375.850137:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368115072:0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850249:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521375.850314:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788521375.850321:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368114688:0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850346:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521375.850364:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368115200:0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850388:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521375.850436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115072 00000100:00100000:0.0:1788521375.850444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115072 00000100:00100000:0.0:1788521375.850501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114688 00000100:00100000:0.0:1788521375.850504:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114688 00000100:00100000:0.0:1788521375.850530:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521375.850538:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368115072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850590:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45633480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368115072:12345-0@lo:400:kworker.0 Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.850597:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788521375.850615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788521375.850621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368114688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850647:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368114688:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.850652:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788521375.850675:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115200 00000100:00100000:0.0:1788521375.850687:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115200 00000100:00100000:0.0:1788521375.850721:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788521375.850728:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368115200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850759:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368115200:12345-0@lo:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.850766:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788521375.850800:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521375.850805:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521375.850841:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368114688:0@lo:400:kworker.0 00010000:00080000:0.0:1788521375.850853:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5df80 x1875400368115200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521375.850863:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368115200:0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.850871:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368115072:0@lo:400:kworker.0 00000100:00100000:3.0:1788521375.851050:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368114816:0@lo:400:kworker.0 00000100:00100000:3.0:1788521375.851082:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521375.851110:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368115328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521375.851130:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521375.851149:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521375.851155:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368114944:0@lo:400:kworker.0 00000100:00100000:3.0:1788521375.851176:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521375.851205:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115328 00000100:00100000:3.0:1788521375.851209:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115328 00000100:00100000:3.0:1788521375.851266:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521375.851273:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368115328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521375.851300:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521375.851335:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368115328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.851341:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521375.851360:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114944 00000100:00100000:3.0:1788521375.851363:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114944 00000100:00100000:3.0:1788521375.851385:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521375.851391:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368114944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521375.851431:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368114944:12345-0@lo:400:kworker.0 Request processed in 41us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521375.851438:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788521375.851470:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5ed80 x1875400368114944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521375.851481:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368114944:0@lo:400:kworker.0 00010000:00080000:3.0:1788521375.851491:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45631f80 x1875400368115328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521375.851504:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368115328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521375.851652:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368114816 00000100:00100000:0.0:1788521375.851657:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368114816 00000100:00100000:0.0:1788521375.851697:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521375.851703:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368114816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521375.851739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368114816:12345-0@lo:400:kworker.0 Request processed in 37us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521375.851745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788521375.851791:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368114816:0@lo:400:kworker.0 00000100:00080000:3.0:1788521375.852076:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521376.745508:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521377.494694:0:11377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788521377.770024:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521377.903242:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521377.903290:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521377.903315:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521377.903347:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058624 00000100:00100000:0.0:1788521377.903374:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058624 00000100:00100000:0.0:1788521377.903432:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058752 00000100:00100000:0.0:1788521377.903435:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058752 00000100:00100000:0.0:1788521377.903458:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:0.0:1788521377.903467:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346058624:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521377.903546:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346058624:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521377.903554:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:0.0:1788521377.903572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:0.0:1788521377.903579:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346058752:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521377.903616:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346058752:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521377.903623:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:3.0:1788521377.904080:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058496 00000100:00100000:3.0:1788521377.904086:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058496 00000100:00100000:3.0:1788521377.904125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00100000:3.0:1788521377.904133:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346058496:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521377.904170:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346058496:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521377.904177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00080000:3.0:1788521377.904204:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521378.793269:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521379.434980:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521379.435014:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368115456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521379.435090:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521379.435150:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115456 00000100:00100000:3.0:1788521379.435156:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115456 00000100:00100000:3.0:1788521379.435204:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521379.435213:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368115456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521379.435250:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521379.435305:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368115456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521379.435312:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788521379.435330:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521379.435359:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5ed80 x1875400368115456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521379.435377:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368115456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521379.817741:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521380.841091:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521380.969108:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368115840:0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.969191:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521380.969259:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521380.969265:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368115968:0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.969298:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521380.969344:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115840 00000100:00100000:3.0:1788521380.969351:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115840 00000100:00100000:3.0:1788521380.969398:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788521380.969406:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368115840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.969447:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368115840:12345-0@lo:400:kworker.0 Request processed in 42us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521380.969453:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788521380.969473:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115968 00000100:00100000:3.0:1788521380.969475:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115968 00000100:00100000:3.0:1788521380.969495:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521380.969500:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.969523:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368115968:12345-0@lo:400:kworker.0 Request processed in 24us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521380.969543:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788521380.969557:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521380.969585:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5d500 x1875400368115968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521380.969599:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368115968:0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.969608:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368115840:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.969710:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368115584:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.969881:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521380.969911:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368116096:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.969931:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521380.969964:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521380.969970:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368115712:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.969988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521380.970002:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368116224:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.970018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521380.970038:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116096 00000100:00100000:1.0:1788521380.970041:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116096 00000100:00100000:1.0:1788521380.970067:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115712 00000100:00100000:1.0:1788521380.970069:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115712 00000100:00100000:1.0:1788521380.970081:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521380.970087:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368116096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.970118:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368116096:12345-0@lo:400:kworker.0 Request processed in 31us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521380.970124:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521380.970134:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521380.970147:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368115712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.970169:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368115712:12345-0@lo:400:kworker.0 Request processed in 23us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521380.970175:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788521380.970198:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368115712:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.970206:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368116096:0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.970358:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368115584 00000100:00100000:3.0:1788521380.970363:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368115584 00000100:00100000:3.0:1788521380.970395:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788521380.970402:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368115584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.970433:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368115584:12345-0@lo:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521380.970439:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788521380.970463:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116224 00000100:00100000:3.0:1788521380.970466:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116224 00000100:00100000:3.0:1788521380.970487:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788521380.970493:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368116224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521380.970517:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368116224:12345-0@lo:400:kworker.0 Request processed in 25us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521380.970523:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788521380.970541:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521380.970544:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788521380.970605:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d15180 x1875400368116224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521380.970616:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368116224:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.970623:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368115584:0@lo:400:kworker.0 00000100:00100000:1.0:1788521380.973117:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521380.973146:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368116352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521380.973212:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521380.973323:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116352 00000100:00100000:2.0:1788521380.973331:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116352 00000100:00100000:2.0:1788521380.973386:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521380.973396:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368116352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521380.973430:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521380.973483:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368116352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521380.973490:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788521380.973661:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a45632a00 x1875400368116352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521380.973680:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45632a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368116352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521381.867357:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521382.032638:0:11477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:29:39 (1788521379) === 00000100:00100000:2.0:1788521382.270131:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521382.270244:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.270388:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346058880 00000100:00100000:3.0:1788521382.270398:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346058880 00000100:00100000:3.0:1788521382.270475:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1788521382.270493:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346058880:12345-192.168.203.48@tcp:41:mkdir.0 00000004:00000024:3.0:1788521382.270544:0:6713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788521382.270621:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346058880:12345-192.168.203.48@tcp:41:mkdir.0 Request processed in 131us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.270629:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1788521382.270654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346059008 00000100:00100000:3.0:1788521382.270658:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346059008 00000100:00100000:3.0:1788521382.270958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521382.270969:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ec78abe-db90-4086-b379-6c867e47751e+6:9665:x1875400346059008:12345-192.168.203.48@tcp:700:mkdir.0 00000100:00100000:3.0:1788521382.271005:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0ec78abe-db90-4086-b379-6c867e47751e+6:9665:x1875400346059008:12345-192.168.203.48@tcp:700:mkdir.0 Request processed in 39us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.271012:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00080000:2.0:1788521382.272032:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521382.279569:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521382.279696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346059264 00000100:00100000:0.0:1788521382.279707:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346059264 00000100:00100000:0.0:1788521382.279816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1788521382.279828:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:9665:x1875400346059264:12345-192.168.203.48@tcp:36:mkdir.0 00010000:00010000:0.0:1788521382.279896:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521382.280099:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae016325 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440274 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.280128:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1c400) 00010000:00010000:0.0:1788521382.280140:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521382.280841:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.280867:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.280887:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.281044:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.281054:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.281062:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521382.292898:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788521382.292918:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.292929:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.292938:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.292944:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521382.292949:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.292959:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.292979:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521382.292983:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521382.292998:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.293005:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016444 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521382.293035:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ed5ac68 reply state 00000000829a1238 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521382.293044:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521382.293168:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:9665:x1875400346059264:12345-192.168.203.48@tcp:36:mkdir.0 Request processed in 13338us (13609us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788521382.293177:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00010000:00010000:1.0:1788521382.296065:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.296089:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.296098:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.296136:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521382.296142:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.296151:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.296173:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c0a4fa31300) 00010000:00010000:1.0:1788521382.296176:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521382.296182:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.296189:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01644b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521382.311005:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.311185:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346059392 00000100:00100000:3.0:1788521382.311195:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346059392 00000100:00100000:3.0:1788521382.311339:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1788521382.311351:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:9666:x1875400346059392:12345-192.168.203.48@tcp:101:chmod.0 00010000:00010000:3.0:1788521382.311381:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521382.311409:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64402f9 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.311475:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.311491:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.311504:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521382.311553:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521382.311557:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521382.311629:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.311653:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f9 expref: 8 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.311670:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f9 expref: 7 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.311678:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4400) 00010000:00010000:3.0:1788521382.311681:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521382.311685:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521382.311747:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:9666:x1875400346059392:12345-192.168.203.48@tcp:101:chmod.0 Request processed in 398us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.311754:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1788521382.318907:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521382.319040:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346059648 00000100:00100000:0.0:1788521382.319056:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346059648 00000100:00100000:0.0:1788521382.319153:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1788521382.319165:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:9666:x1875400346059648:12345-192.168.203.48@tcp:36:chmod.0 00010000:00010000:0.0:1788521382.319219:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521382.319246:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f9 expref: 7 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.319269:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4400) 00010000:00010000:0.0:1788521382.319279:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521382.319304:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.319318:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.319328:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521382.319637:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000223c8893 reply state 00000000e5504ff9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521382.319646:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788521382.319654:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788521382.319743:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:9666:x1875400346059648:12345-192.168.203.48@tcp:36:chmod.0 Request processed in 580us (855us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788521382.319752:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00010000:00010000:0.0:1788521382.323222:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.323240:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.323249:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.323255:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521382.323259:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.323267:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.323283:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521382.323287:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788521382.323292:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.323298:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016460 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521382.346140:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.346287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346059776 00000100:00100000:1.0:1788521382.346301:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346059776 00000100:00100000:1.0:1788521382.346380:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1788521382.346394:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:9667:x1875400346059776:12345-192.168.203.48@tcp:101:chown.0 00010000:00010000:1.0:1788521382.346426:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521382.346461:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016467 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440300 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.346551:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae01646e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.346567:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae01646e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.346589:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae01646e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521382.346659:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521382.346663:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521382.346706:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae01646e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.346738:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016467 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440300 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.346763:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae01646e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440300 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.346807:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521382.346811:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521382.346815:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166e200, rc 0) 00000100:00100000:1.0:1788521382.346899:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:9667:x1875400346059776:12345-192.168.203.48@tcp:101:chown.0 Request processed in 509us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.346905:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:2.0:1788521382.353473:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.354000:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346059904 00000100:00100000:3.0:1788521382.354022:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346059904 00000100:00100000:3.0:1788521382.354112:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1788521382.354126:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:9667:x1875400346059904:12345-192.168.203.48@tcp:101:chown.0 00010000:00010000:3.0:1788521382.354156:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521382.354188:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016475 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440307 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354305:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354324:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354338:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354357:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354365:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354372:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354486:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae01648a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354495:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae01648a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354502:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae01648a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521382.354541:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521382.354546:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521382.354574:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae01648a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354911:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354918:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354926:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354933:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521382.354938:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354946:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.354962:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521382.355067:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521382.355074:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355082:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae01647c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355098:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355104:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355110:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355125:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521382.355128:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355135:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355143:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c0a65ff4f00) 00010000:00010000:3.0:1788521382.355146:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521382.355148:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355153:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016483 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355195:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016475 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440307 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355213:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae01648a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440307 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.355220:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a65ff4600) 00010000:00010000:3.0:1788521382.355223:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521382.355226:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521382.355378:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:9667:x1875400346059904:12345-192.168.203.48@tcp:101:chown.0 Request processed in 1254us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521382.355389:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1788521382.363763:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.363922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346060160 00000100:00100000:1.0:1788521382.363936:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346060160 00000100:00100000:1.0:1788521382.364029:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521382.364042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+9:9667:x1875400346060160:12345-192.168.203.48@tcp:36:chown.0 00010000:00010000:1.0:1788521382.364117:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521382.364152:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae01648a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440307 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.364178:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a65ff4600) 00010000:00010000:1.0:1788521382.364208:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521382.364243:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.364260:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.364272:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521382.460100:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1788521382.460144:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788521382.460502:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c8b79ae reply state 000000000f915bb5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521382.460520:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788521382.460541:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788521382.460683:0:5833:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788521382.460752:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:9667:x1875400346060160:12345-192.168.203.48@tcp:36:chown.0 Request processed in 96705us (96998us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788521382.460763:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00010000:00010000:3.0:1788521382.463512:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.463537:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.463546:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.463553:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521382.463559:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.463569:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.463592:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a42b1c800) 00010000:00010000:3.0:1788521382.463596:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521382.463602:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.463609:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521382.478871:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521382.479125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346060288 00000100:00100000:0.0:1788521382.479140:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346060288 00000100:00100000:0.0:1788521382.479284:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1788521382.479299:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:9668:x1875400346060288:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:0.0:1788521382.479331:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521382.479360:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644030e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521382.483759:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4329us 00010000:00010000:0.0:1788521382.526982:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527003:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527016:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527032:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527039:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527045:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527367:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045e00/0x53df1cebae0164ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527387:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045e00/0x53df1cebae0164ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527394:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045e00/0x53df1cebae0164ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521382.527418:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788521382.527421:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521382.527456:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045e00/0x53df1cebae0164ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527469:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527475:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527483:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527488:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521382.527493:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527500:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527513:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:0.0:1788521382.527516:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521382.527521:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527538:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01649f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527553:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527559:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527564:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527569:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521382.527572:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527578:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527586:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c0a4fa31900) 00010000:00010000:0.0:1788521382.527588:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521382.527591:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527596:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0164a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527631:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644030e expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527647:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045e00/0x53df1cebae0164ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644030e expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.527661:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521382.527663:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788521382.527666:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045e00, rc 0) 00000100:00100000:0.0:1788521382.527742:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:9668:x1875400346060288:12345-192.168.203.48@tcp:101:touch.500 Request processed in 48447us (48894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521382.527751:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1788521382.537840:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.538028:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346060544 00000100:00100000:3.0:1788521382.538038:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346060544 00000100:00100000:3.0:1788521382.538099:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1788521382.538109:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:9668:x1875400346060544:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:3.0:1788521382.538130:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521382.538152:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440315 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.538448:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.538462:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.538474:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.538489:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.538497:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.538503:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521382.539634:0:6713:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788521382.540259:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0164c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540273:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0164c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540285:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0164c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540323:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540342:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540349:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540355:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521382.540359:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540367:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540380:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:3.0:1788521382.540383:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521382.540387:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540394:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0164bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521382.540407:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f769c82a reply state 000000006959b387 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521382.540415:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788521382.540449:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440315 expref: 10 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540463:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0164c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440315 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.540481:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521382.540484:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521382.540486:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1a00, rc 0) 00000100:00100000:3.0:1788521382.541261:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+10:9668:x1875400346060544:12345-192.168.203.48@tcp:101:touch.500 Request processed in 3147us (3426us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788521382.541272:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00010000:00010000:0.0:1788521382.543657:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.543672:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.543679:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.543941:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521382.543946:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.543954:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.544060:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8c0a65ff4f00) 00010000:00010000:0.0:1788521382.544064:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521382.544069:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.544076:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0164c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521382.545571:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.545648:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346060800 00000100:00100000:3.0:1788521382.545660:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346060800 00000100:00100000:3.0:1788521382.545737:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:3.0:1788521382.545748:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:9668:x1875400346060800:12345-192.168.203.48@tcp:36:touch.500 00010000:00010000:3.0:1788521382.546096:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521382.546128:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0164c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440315 expref: 9 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.546147:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521382.546159:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521382.546203:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.546221:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.546231:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521382.546363:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000520420a4 reply state 000000009c27faed transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521382.546393:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521382.546528:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+10:9668:x1875400346060800:12345-192.168.203.48@tcp:36:touch.500 Request processed in 781us (965us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788521382.546535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00010000:00010000:3.0:1788521382.548692:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.548707:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.548714:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.548719:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521382.548724:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.548731:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.548746:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a65ff4700) 00010000:00010000:3.0:1788521382.548749:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521382.548754:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.548761:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0164d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521382.549902:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.549962:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346060928 00000100:00100000:1.0:1788521382.549981:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346060928 00000100:00100000:1.0:1788521382.550044:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1788521382.550056:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+9:9668:x1875400346060928:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:1.0:1788521382.550078:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521382.550099:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f800/0x53df1cebae0164de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644031c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.550158:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f800/0x53df1cebae0164de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644031c expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.550195:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f800/0x53df1cebae0164de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644031c expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.550216:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a42b1c200) 00010000:00010000:1.0:1788521382.550219:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521382.550222:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166f800, rc 0) 00000100:00100000:1.0:1788521382.550289:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:9668:x1875400346060928:12345-192.168.203.48@tcp:101:touch.500 Request processed in 235us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.550296:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:2.0:1788521382.552493:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.552561:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346061056 00000100:00100000:3.0:1788521382.552570:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346061056 00000100:00100000:0.0:1788521382.554128:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1788521382.554141:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2344:x1875400346061056:12345-192.168.203.48@tcp:8:touch.500 00010000:00080000:0.0:1788521382.554178:0:6690:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:0.0:1788521382.554462:0:6690:0:(genops.c:1385:class_connect()) connect: client 0ec78abe-db90-4086-b379-6c867e47751e, cookie 0x53df1cebae0164e5 00002000:00100000:0.0:1788521382.554475:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ec78abe-db90-4086-b379-6c867e47751e/ffff8c0a45732800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788521382.554486:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788521382.554718:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521382.554753:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a45733800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521382.555370:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2344:x1875400346061056:12345-192.168.203.48@tcp:8:touch.500 Request processed in 1226us (2879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521382.555380:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1788521382.558972:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.559370:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346061184 00000100:00100000:3.0:1788521382.559381:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346061184 00000100:00100000:3.0:1788521382.559459:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1788521382.559470:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:0:x1875400346061184:12345-192.168.203.48@tcp:2:touch.500 00000100:00080000:2.0:1788521382.559874:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788521382.655132:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000001:00080000:2.0:1788521382.655152:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788521382.655316:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:0:x1875400346061184:12345-192.168.203.48@tcp:2:touch.500 Request processed in 95843us (96356us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788521382.655327:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1788521382.673162:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521382.673571:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346061440 00000100:00100000:0.0:1788521382.673581:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346061440 00000100:00100000:0.0:1788521382.673647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1788521382.673657:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:9668:x1875400346061440:12345-192.168.203.48@tcp:35:touch.500 00000100:00100000:3.0:1788521382.674340:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+11:9668:x1875400346061440:12345-192.168.203.48@tcp:35:touch.500 Request processed in 681us (1183us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788521382.674353:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1788521382.690906:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521382.691504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346061568 00000100:00100000:0.0:1788521382.691515:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346061568 00000100:00100000:0.0:1788521382.691750:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1788521382.691762:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+11:9669:x1875400346061568:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:0.0:1788521382.691821:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521382.691841:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0164ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440323 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.691936:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045600/0x53df1cebae0164f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.691950:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045600/0x53df1cebae0164f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521382.691973:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045600/0x53df1cebae0164f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521382.692597:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521382.692603:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521382.692657:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045600/0x53df1cebae0164f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.692686:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0164ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440323 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.692706:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045600/0x53df1cebae0164f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440323 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.692715:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521382.692718:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521382.692721:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045600, rc 0) 00000100:00100000:1.0:1788521382.692822:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+12:9669:x1875400346061568:12345-192.168.203.48@tcp:101:rm.0 Request processed in 1062us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.692831:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1788521382.705180:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.706085:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346061824 00000100:00100000:1.0:1788521382.706097:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346061824 00000100:00100000:1.0:1788521382.706163:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:1.0:1788521382.706173:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+12:9669:x1875400346061824:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:1.0:1788521382.706193:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521382.706222:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166ea00/0x53df1cebae0164fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644032a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521382.706310:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788521382.706459:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166ea00/0x53df1cebae0164fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644032a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.706474:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521382.706477:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521382.706482:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166ea00/0x53df1cebae0164fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644032a expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.706497:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a4166ea00, rc 0) 00000100:00100000:1.0:1788521382.706560:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:9669:x1875400346061824:12345-192.168.203.48@tcp:101:rm.0 Request processed in 388us (1388us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788521382.706568:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:2.0:1788521382.716709:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.716865:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346061952 00000100:00100000:3.0:1788521382.716874:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346061952 00000100:00100000:3.0:1788521382.716932:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1788521382.716942:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:9669:x1875400346061952:12345-192.168.203.48@tcp:37:rm.0 00000100:00100000:1.0:1788521382.724770:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:9669:x1875400346061952:12345-192.168.203.48@tcp:37:rm.0 Request processed in 7819us (8060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.727284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1788521382.729416:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521382.729600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346062208 00000100:00100000:2.0:1788521382.729610:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346062208 00000100:00100000:2.0:1788521382.729749:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1788521382.729759:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a89050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+13:9669:x1875400346062208:12345-192.168.203.48@tcp:35:rm.0 00000100:00100000:2.0:1788521382.730216:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a89050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+14:9669:x1875400346062208:12345-192.168.203.48@tcp:35:rm.0 Request processed in 456us (806us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788521382.730224:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1788521382.736405:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521382.736503:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346062464 00000100:00100000:3.0:1788521382.736512:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346062464 00000100:00100000:3.0:1788521382.736574:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1788521382.736584:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+14:9669:x1875400346062464:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:3.0:1788521382.736607:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521382.736627:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440331 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.736721:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae01650f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.736735:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae01650f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.736769:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae01650f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521382.736824:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788521382.737121:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440331 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.737141:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae01650f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440331 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.737149:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:3.0:1788521382.737152:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521382.737155:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1a00, rc 0) 00000100:00100000:2.0:1788521382.737505:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346062464:12345-192.168.203.48@tcp:101:rm.0 Request processed in 921us (1107us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788521382.737514:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1788521382.740672:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.740752:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346062592 00000100:00100000:1.0:1788521382.740761:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346062592 00000100:00100000:1.0:1788521382.740844:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1788521382.740863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346062592:12345-192.168.203.48@tcp:41:rm.0 00000004:00000024:1.0:1788521382.740943:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788521382.741024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346062592:12345-192.168.203.48@tcp:41:rm.0 Request processed in 163us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.741031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1788521382.743449:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.743576:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346062720 00000100:00100000:1.0:1788521382.743592:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346062720 00000100:00100000:1.0:1788521382.743645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:1.0:1788521382.743654:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346062720:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:1.0:1788521382.743672:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521382.743691:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166ea00/0x53df1cebae01651d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440338 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743750:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743764:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743803:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743843:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743860:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743868:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743980:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743989:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.743997:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521382.744031:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788521382.744035:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521382.744053:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744064:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744073:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744079:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744087:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744093:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521382.744097:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744106:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744125:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521382.744127:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521382.744132:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744140:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f000/0x53df1cebae016524 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744158:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744164:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744170:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744175:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521382.744178:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744185:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744193:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521382.744195:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521382.744913:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.744921:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01652b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.745080:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166ea00/0x53df1cebae01651d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440338 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.745098:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440338 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.745105:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a42b1c200) 00010000:00010000:1.0:1788521382.745108:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521382.745110:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b200, rc 0) 00000100:00100000:1.0:1788521382.745223:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+17:9669:x1875400346062720:12345-192.168.203.48@tcp:101:rm.0 Request processed in 1569us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521382.745231:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:2.0:1788521382.755812:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521382.755875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346062976 00000100:00100000:1.0:1788521382.755884:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346062976 00000100:00100000:1.0:1788521382.755948:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1788521382.755958:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+17:9669:x1875400346062976:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:1.0:1788521382.756022:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788521382.756049:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440338 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756070:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166f800/0x53df1cebae0164de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644031c expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756082:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a42b1c200) 00010000:00010000:1.0:1788521382.756097:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045600/0x53df1cebae0164f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440323 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756125:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521382.756129:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521382.756149:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756162:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756172:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756186:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756193:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756211:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756314:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756322:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.756330:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521382.757056:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788521382.757068:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303835293886ns, next at 304835291516ns, rc = 0 00010000:00010000:1.0:1788521382.757132:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757143:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757150:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757158:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757165:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757172:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757198:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521382.757216:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757223:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757230:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757236:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521382.757240:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757249:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757265:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:1.0:1788521382.757268:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788521382.757272:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757279:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016547 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757296:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757303:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757309:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757315:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521382.757318:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757325:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757332:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521382.757334:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521382.757337:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.757344:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016539 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521382.757362:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000baa875d8 reply state 000000000c41cb81 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521382.757371:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521382.757452:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346062976:12345-192.168.203.48@tcp:36:rm.0 Request processed in 1494us (1648us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788521382.757462:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00010000:00010000:2.0:1788521382.760158:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521382.760172:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.760183:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521382.760188:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.760198:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.760237:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:2.0:1788521382.760240:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788521382.760309:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.760317:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae01654e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.760356:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521382.760358:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521382.760359:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521382.762446:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.762463:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.762470:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.762477:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521382.762482:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.762498:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.762513:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8c0a42b1cd00) 00010000:00010000:2.0:1788521382.762516:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521382.762520:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.762545:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016540 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521382.762960:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521382.764996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346063232 00000100:00100000:2.0:1788521382.765011:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346063232 00000100:00100000:2.0:1788521382.765081:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1788521382.765091:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+15:9669:x1875400346063232:12345-192.168.203.48@tcp:35:rm.0 00000100:00100000:2.0:1788521382.765355:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346063232:12345-192.168.203.48@tcp:35:rm.0 Request processed in 264us (2400us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788521382.765363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1788521382.768329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521382.768543:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346063488 00000100:00100000:2.0:1788521382.768552:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346063488 00000100:00100000:2.0:1788521382.769886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:2.0:1788521382.769909:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+16:9669:x1875400346063488:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:2.0:1788521382.769975:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521382.770001:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae01650f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440331 expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770025:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045e00/0x53df1cebae0164ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644030e expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770037:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:2.0:1788521382.770052:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a4166e200/0x53df1cebae01646e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440300 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770064:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521382.770090:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521382.770116:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770128:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770138:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770150:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770157:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770163:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770979:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.770993:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.771001:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521382.772708:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788521382.772732:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.772741:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.772759:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.772764:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beae00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521382.772769:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.772978:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.772996:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:2.0:1788521382.772999:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788521382.773004:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773011:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae016563 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773036:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773042:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773047:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773052:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521382.773054:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773069:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773077:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a46737200) 00010000:00010000:2.0:1788521382.773080:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521382.773083:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521382.773088:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016555 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521382.773101:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c88cd96a reply state 00000000b1e5e110 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521382.773109:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521382.773367:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+15:9669:x1875400346063488:12345-192.168.203.48@tcp:36:rm.0 Request processed in 3463us (5042us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788521382.773376:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00010000:00010000:3.0:1788521382.779237:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.779263:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.779271:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.779278:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beba00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521382.779282:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.779291:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.779329:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c0a46737b00) 00010000:00010000:3.0:1788521382.779332:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521382.779337:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521382.779344:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01655c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521382.895802:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521383.033148:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521383.033231:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346063744 00000100:00100000:1.0:1788521383.033241:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346063744 00000100:00100000:1.0:1788521383.033315:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:1.0:1788521383.033326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346063744:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521383.033403:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346063744:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 78us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521383.033411:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00080000:2.0:1788521383.033607:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521383.034480:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521383.034738:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346063616 00000100:00100000:1.0:1788521383.034746:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346063616 00000100:00100000:1.0:1788521383.034805:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 248 00000100:00100000:1.0:1788521383.034814:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346063616:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521383.034887:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346063616:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521383.034894:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 248 00010000:00010000:2.0:1788521383.914169:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521384.552962:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368116480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521384.553034:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521384.553212:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116480 00000100:00100000:2.0:1788521384.553220:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116480 00000100:00100000:2.0:1788521384.553287:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788521384.553312:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368116480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521384.553343:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521384.553389:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368116480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521384.553396:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788521384.553502:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788521384.553534:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75d14a80 x1875400368116480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521384.553552:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368116480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521384.938390:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521385.961064:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788521386.088981:0:7966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307167205079ns, next at 308167202468ns, rc = 0 00000100:00100000:2.0:1788521386.089076:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a4641aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368116608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521386.089150:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521386.089229:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116608 00000100:00100000:1.0:1788521386.089237:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116608 00000100:00100000:1.0:1788521386.089297:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788521386.089324:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368116608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521386.089357:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521386.089381:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368117120:0@lo:400:kworker.0 00000100:00100000:1.0:1788521386.089404:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368116608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521386.089412:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521386.089418:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788521386.089464:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a4641aa00 x1875400368116608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521386.089483:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a4641aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368116608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521386.089498:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788521386.089504:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368116736:0@lo:400:kworker.0 00000100:00100000:2.0:1788521386.089534:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521386.089559:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368116864:0@lo:400:kworker.0 00000100:00100000:2.0:1788521386.089568:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368117248:0@lo:400:kworker.0 00000100:00100000:3.0:1788521386.089614:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521386.089639:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a4641b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368116992:0@lo:400:kworker.0 00000100:00080000:3.0:1788521386.089656:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521386.089667:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521386.089695:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116864 00000100:00100000:3.0:1788521386.089700:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116864 00000100:00100000:0.0:1788521386.089720:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368117120 00000100:00100000:0.0:1788521386.089726:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368117120 00000100:00100000:3.0:1788521386.089735:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116992 00000100:00100000:3.0:1788521386.089741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116992 00000100:00100000:0.0:1788521386.089794:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788521386.089806:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521386.089807:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368117120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521386.089818:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368116864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521386.089895:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368116736 00000100:00100000:1.0:1788521386.089903:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368116736 00000100:00100000:1.0:1788521386.089927:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788521386.089934:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368116736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521386.093384:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368117120:12345-0@lo:400:kworker.0 Request processed in 3573us (3956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521386.093398:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521386.093483:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788521386.093498:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368116992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521386.093548:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368116992:12345-0@lo:400:kworker.0 Request processed in 57us (3882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521386.093554:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:0.0:1788521386.095159:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521386.095168:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521386.095198:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788521386.095348:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a46419c00 x1875400368117120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521386.095364:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368117120:0@lo:400:kworker.0 00000100:00100000:0.0:1788521386.095394:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368117248 00000100:00100000:0.0:1788521386.095400:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368117248 00000100:00100000:0.0:1788521386.095447:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788521386.095456:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368117248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521386.095518:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368117248:12345-0@lo:400:kworker.0 Request processed in 64us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521386.095525:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1788521386.095544:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521386.095564:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368117248:0@lo:400:kworker.0 00000100:00100000:3.0:1788521386.096759:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368116864:12345-0@lo:400:kworker.0 Request processed in 6938us (7139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521386.096799:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788521386.097293:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368116864:0@lo:400:kworker.0 00000100:00100000:2.0:1788521386.099348:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a4641b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368116992:0@lo:400:kworker.0 00000100:00100000:1.0:1788521386.102228:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368116736:12345-0@lo:400:kworker.0 Request processed in 12286us (12685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521386.102241:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788521386.102313:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368116736:0@lo:400:kworker.0 00010000:00010000:3.0:1788521386.986078:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521387.420526:0:11626:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1788521387.701079:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000004:00080000:1.0:1788521387.701109:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1788521387.701121:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:1.0:1788521387.701124:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788521387.701253:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368117376:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788521387.701320:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521387.701388:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368117376 00000100:00100000:1.0:1788521387.701395:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368117376 00000100:00100000:1.0:1788521387.701439:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521387.701448:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368117376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788521387.701475:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788521387.701509:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9aaba6, atime: 0x6a9aaba6, ctime: 0x6a9aaba6, blocks: 0x1 00010000:00010000:1.0:1788521387.701517:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521387.701554:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1788521387.701559:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521387.701566:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521387.701581:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521387.701590:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521387.701598:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521387.701612:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521387.701858:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521387.701866:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521387.701874:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521387.701878:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521387.701888:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521387.701919:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521387.701939:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae01656a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521387.701960:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521387.701962:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521387.701964:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521387.703105:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1788521387.703169:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368117376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1719us (1845us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788521387.703179:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788521387.707001:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a46419500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788521387.707019:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46419500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368117376:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788521388.011630:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521388.144368:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521388.144413:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521388.144419:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346063872 00000100:00100000:0.0:1788521388.144428:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346063872 00000100:00100000:3.0:1788521388.144449:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521388.144474:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521388.144475:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:0.0:1788521388.144484:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346063872:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521388.144553:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346063872:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521388.144572:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:0.0:1788521388.144605:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064000 00000100:00100000:0.0:1788521388.144609:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064000 00000100:00100000:0.0:1788521388.144641:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064256 00000100:00100000:0.0:1788521388.144644:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064256 00000100:00100000:2.0:1788521388.144749:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064128 00000100:00100000:2.0:1788521388.144754:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064128 00000100:00100000:2.0:1788521388.144807:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:2.0:1788521388.144826:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346064128:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521388.144856:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346064128:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521388.144862:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1788521388.145024:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:0.0:1788521388.145032:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346064000:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521388.145066:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346064000:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521388.145073:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:0.0:1788521388.145085:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:0.0:1788521388.145101:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346064256:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521388.145126:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346064256:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521388.145132:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00080000:0.0:1788521388.145480:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521388.145485:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788521388.418440:0:11675:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe16eb4790 20000000:00000080:1.0:1788521388.418458:0:11675:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c0a7f223000 uarg=0000000000000000 20000000:01000000:1.0:1788521388.418495:0:11675:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788521388.418501:0:11675:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788521388.418507:0:11675:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788521388.420137:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788521388.420277:0:11675:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788521388.432690:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788521388.432744:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788521388.432875:0:11675:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788521388.432893:0:11675:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788521388.432912:0:11675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.432931:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01640c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.432939:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01641a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.432945:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016428 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.432955:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.432962:0:11675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.432970:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433008:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433024:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 12 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521388.433039:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117504:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521388.433145:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433161:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521388.433170:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117632:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521388.433202:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae016428 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433208:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae016428 expref: 18 pid: 5825 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521388.433216:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46419c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117760:0@lo:104: 00000100:00100000:1.0:1788521388.433250:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521388.433296:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368117760 00000100:00100000:1.0:1788521388.433303:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368117760 00000100:00100000:1.0:1788521388.433345:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788521388.433353:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:11675:x1875400368117760:12345-0@lo:104: 00010000:00010000:1.0:1788521388.433365:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433408:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788521388.433413:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:11675:x1875400368117760:12345-0@lo:104: Request processed in 62us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521388.433420:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1788521388.433468:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae01641a expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433475:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae01641a expref: 18 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521388.433489:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117888:0@lo:104: 00000100:00100000:1.0:1788521388.433512:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521388.433533:0:11675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae01640c expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433541:0:11675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae01640c expref: 18 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521388.433549:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368118016:0@lo:104: 00000100:00100000:1.0:1788521388.433572:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521388.433595:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788521388.433605:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368117888 00000100:00100000:1.0:1788521388.433608:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368117888 00000100:00100000:1.0:1788521388.433628:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118016 00000100:00100000:1.0:1788521388.433630:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118016 00000100:00100000:1.0:1788521388.433645:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521388.433650:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:11675:x1875400368117888:12345-0@lo:104: 00010000:00010000:1.0:1788521388.433658:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433688:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788521388.433693:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+4:11675:x1875400368117888:12345-0@lo:104: Request processed in 43us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521388.433699:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521388.433711:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521388.433716:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddf3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:11675:x1875400368118016:12345-0@lo:104: 00010000:00010000:1.0:1788521388.433723:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521388.433755:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788521388.433760:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddf3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+3:11675:x1875400368118016:12345-0@lo:104: Request processed in 45us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521388.433766:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521388.433833:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7a886840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521388.433855:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46419c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117760:0@lo:104: 00000100:00100000:1.0:1788521388.433863:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117888:0@lo:104: 00000100:00100000:1.0:1788521388.433869:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368118016:0@lo:104: 00010000:00010000:2.0:1788521388.434113:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788521388.434119:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434127:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521388.434131:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434151:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.434158:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.434164:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521388.434197:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434204:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.434223:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434231:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae016428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01642f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434245:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788521388.434248:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434253:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb800 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521388.434256:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434262:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.434267:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.434279:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521388.434293:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434298:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.434312:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434318:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a81beb800/0x53df1cebae01641a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016421 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434326:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521388.434329:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434334:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521388.434336:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434341:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521388.434347:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521388.434351:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788521388.434361:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434366:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521388.434378:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434398:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a4166f200/0x53df1cebae01640c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae016413 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.434411:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.434412:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521388.434414:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521388.434427:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368118144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.434458:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.434487:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368118272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.434505:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521388.434519:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521388.434523:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368118400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521388.434540:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521388.435408:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521388.435426:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118144 00000100:00100000:3.0:1788521388.435433:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118144 00010000:00010000:3.0:1788521388.435464:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016428 expref: 19 pid: 5825 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521388.435501:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118272 00000100:00100000:3.0:1788521388.435506:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118272 00010000:00010000:3.0:1788521388.435518:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01641a expref: 20 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521388.435530:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118400 00000100:00100000:3.0:1788521388.435533:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118400 00010000:00010000:3.0:1788521388.435545:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01640c expref: 21 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521388.435560:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521388.435568:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+21:3301:x1875400368118144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521388.435580:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521388.435586:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae016428 expref: 21 pid: 5825 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435609:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae016428 expref: 21 pid: 5825 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435626:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166e400/0x53df1cebae01642f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae016428 expref: 21 pid: 5825 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435642:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521388.435692:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+20:3301:x1875400368118144:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521388.435699:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788521388.435715:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521388.435722:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368118272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521388.435730:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521388.435734:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01641a expref: 19 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435741:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae01641a expref: 19 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435758:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c4200/0x53df1cebae016421 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae01641a expref: 19 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435768:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521388.435826:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3302:x1875400368118272:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521388.435833:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521388.435846:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521388.435852:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3302:x1875400368118400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521388.435867:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521388.435871:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01640c expref: 17 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435880:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae01640c expref: 17 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435891:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea600/0x53df1cebae016413 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae01640c expref: 17 pid: 5826 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.435899:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521388.435922:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46425c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3302:x1875400368118400:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521388.435933:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521388.436005:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368118144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521388.436031:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368118400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521388.436039:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368118272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521388.440450:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117504:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521388.441845:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521388.441989:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11675:1875400368117632:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521388.442021:0:11675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521388.442419:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064384 00000100:00100000:0.0:1788521388.442426:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064384 00010000:00010000:0.0:1788521388.442461:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 13 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521388.442496:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1788521388.442505:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346064384:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521388.442517:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521388.442523:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 13 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521388.442545:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 13 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521388.442562:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166ec00/0x53df1cebae01643d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402f2 expref: 13 pid: 5828 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521388.442575:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521388.442756:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:2345:x1875400346064384:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 251us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521388.442763:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1788521388.449656:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521388.449724:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064512 00000100:00100000:3.0:1788521388.449734:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064512 00010000:00010000:3.0:1788521388.449797:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521388.449842:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1788521388.450174:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:2346:x1875400346064512:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521388.450192:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521388.450215:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450230:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450249:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea200/0x53df1cebae016436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402eb expref: 12 pid: 5826 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450266:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450275:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450292:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450300:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450308:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450315:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450321:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521388.450327:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450335:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450369:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521388.450380:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521388.450437:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:2346:x1875400346064512:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 268us (790us total) trans 0 rc 0/0 00010000:00010000:2.0:1788521388.450482:0:11675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.450491:0:11675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521388.450498:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a7575b200/0x53df1cebae016571 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521388.458551:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00010000:00010000:2.0:1788521389.033079:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521389.673073:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368118528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521389.673159:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521389.673415:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118528 00000100:00100000:3.0:1788521389.673424:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118528 00000100:00100000:3.0:1788521389.673539:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788521389.673549:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368118528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521389.673585:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521389.673632:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368118528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521389.673651:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788521389.674128:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5fb80 x1875400368118528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521389.674165:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368118528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521389.674445:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521389.876688:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521389.876870:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064640 00000100:00100000:1.0:1788521389.876880:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064640 00000100:00100000:1.0:1788521389.876942:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:1.0:1788521389.876952:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:5589:x1875400346064640:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521389.876969:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521389.876998:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a7575be00/0x53df1cebae016578 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644033f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521389.877028:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575be00/0x53df1cebae016578 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644033f expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521389.877062:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a7575be00/0x53df1cebae016578 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644033f expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521389.877071:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575be00, rc 0) 00000100:00100000:1.0:1788521389.877135:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346064640:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 185us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521389.877142:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:0.0:1788521389.880682:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521389.880817:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064768 00000100:00100000:2.0:1788521389.880827:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064768 00000100:00100000:2.0:1788521389.880882:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:2.0:1788521389.880891:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346064768:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521389.881170:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346064768:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 279us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521389.881178:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:3.0:1788521389.886582:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521389.886718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346064896 00000100:00100000:0.0:1788521389.886730:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346064896 00000100:00100000:0.0:1788521389.886826:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:0.0:1788521389.886836:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346064896:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521389.887074:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346064896:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 237us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521389.887082:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:3.0:1788521389.891351:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521389.891712:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065024 00000100:00100000:1.0:1788521389.891722:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065024 00000100:00100000:1.0:1788521389.891811:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00100000:1.0:1788521389.891821:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:9939:x1875400346065024:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521389.892064:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:9939:x1875400346065024:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 245us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521389.892072:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00100000:3.0:1788521389.901991:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521389.902769:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065152 00000100:00100000:2.0:1788521389.902815:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065152 00000100:00100000:2.0:1788521389.902875:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 255 00000100:00100000:2.0:1788521389.902885:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:9939:x1875400346065152:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521389.903153:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:9939:x1875400346065152:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 268us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521389.903161:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 255 00000100:00100000:3.0:1788521389.907259:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521389.907355:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065280 00000100:00100000:0.0:1788521389.907364:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065280 00000100:00100000:0.0:1788521389.907420:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 256 00000100:00100000:0.0:1788521389.907430:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:5589:x1875400346065280:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521389.907446:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521389.907463:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a82045e00/0x53df1cebae01657f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440346 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521389.907516:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a82045e00/0x53df1cebae01657f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440346 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521389.907528:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a82045e00/0x53df1cebae01657f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440346 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521389.907537:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045e00, rc 0) 00000100:00100000:0.0:1788521389.907594:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346065280:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 166us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521389.907602:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 256 00000100:00100000:3.0:1788521389.909641:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521389.909731:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065408 00000100:00100000:1.0:1788521389.909740:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065408 00000100:00100000:1.0:1788521389.909829:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 257 00000100:00100000:1.0:1788521389.909838:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346065408:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521389.910129:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346065408:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 290us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521389.910136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 257 00000100:00100000:3.0:1788521389.917155:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521389.919829:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065536 00000100:00100000:2.0:1788521389.919843:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065536 00000100:00100000:2.0:1788521389.920068:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 258 00000100:00100000:2.0:1788521389.920079:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346065536:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521389.920316:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:5589:x1875400346065536:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 239us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521389.920324:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 258 00000100:00100000:3.0:1788521389.924986:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521389.938143:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065664 00000100:00100000:2.0:1788521389.938157:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065664 00000100:00100000:2.0:1788521389.938214:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 259 00000100:00100000:2.0:1788521389.938223:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:9942:x1875400346065664:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521389.938447:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:9942:x1875400346065664:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 225us (13470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521389.938456:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 259 00000100:00100000:3.0:1788521389.943336:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521389.943457:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065792 00000100:00100000:2.0:1788521389.943477:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065792 00000100:00100000:2.0:1788521389.943527:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 260 00000100:00100000:2.0:1788521389.943538:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:9942:x1875400346065792:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521389.943809:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:9942:x1875400346065792:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 262us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521389.943818:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 260 00010000:00010000:3.0:1788521390.058370:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521390.248908:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521390.248916:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a7f66c000 from 7 10000000:01000000:1.0:1788521390.248921:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521390.248984:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521390.249012:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521390.249024:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521390.249050:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368118656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.249135:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521390.249202:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7a886300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521390.249352:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118656 00000100:00100000:2.0:1788521390.249359:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118656 00000100:00100000:2.0:1788521390.249410:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788521390.249420:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:5830:x1875400368118656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521390.249434:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521390.249448:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81beb800/0x53df1cebae01658d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016586 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.249482:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beb800/0x53df1cebae01658d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016586 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.249494:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81beb800/0x53df1cebae01658d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016586 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.249502:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb800, rc 0) 00000100:00100000:2.0:1788521390.249563:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368118656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521390.249570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788521390.249605:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368118656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521390.249629:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521390.249639:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521390.249691:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368118784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.252973:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521390.253015:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a46245840 going to sleep for 11 seconds 00000100:00100000:0.0:1788521390.253523:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118784 00000100:00100000:0.0:1788521390.253534:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118784 00000100:00100000:0.0:1788521390.253594:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788521390.253605:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368118784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521390.253957:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368118784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521390.253965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788521390.254492:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368118784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.254554:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368118912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.254606:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521390.254651:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a46245840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521390.258196:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368118912 00000100:00100000:2.0:1788521390.258213:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368118912 00000100:00100000:2.0:1788521390.258299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788521390.258310:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368118912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521390.258565:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368118912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 256us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521390.258573:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788521390.259483:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368118912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.261972:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11689:1875400368119040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521390.262059:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521390.262107:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a46245300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521390.262223:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119040 00000100:00100000:1.0:1788521390.262231:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119040 00000100:00100000:1.0:1788521390.262291:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788521390.262301:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:11689:x1875400368119040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521390.262524:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:11689:x1875400368119040:12345-0@lo:502:llog_process_th.0 Request processed in 223us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521390.262532:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788521390.262847:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11689:1875400368119040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521390.262879:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521390.262890:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521390.262892:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521390.262899:0:11689:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c0a7f66c000 00000020:00000080:3.0:1788521390.262902:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521390.262999:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11689:1875400368119168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521390.263036:0:11689:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521390.263075:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a46245300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521390.263162:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119168 00000100:00100000:0.0:1788521390.263168:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119168 00000100:00100000:0.0:1788521390.263205:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788521390.263215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:11689:x1875400368119168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521390.263372:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:11689:x1875400368119168:12345-0@lo:502:llog_process_th.0 Request processed in 160us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521390.263379:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788521390.265892:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11689:1875400368119168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521390.266094:0:11689:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521390.266104:0:11689:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521390.266107:0:11689:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788521390.266113:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788521390.266552:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788521390.266573:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521390.266593:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521390.266604:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521390.266614:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521390.266617:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a75d22000 from 7 10000000:01000000:0.0:1788521390.266619:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521390.266665:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521390.266673:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521390.266683:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521390.266703:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521390.266763:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521390.266831:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521390.269262:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119296 00000100:00100000:3.0:1788521390.269276:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119296 00000100:00100000:3.0:1788521390.269335:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788521390.269345:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:5830:x1875400368119296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521390.269363:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521390.269380:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01659b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae016594 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521390.269408:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01659b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae016594 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521390.269420:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01659b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae016594 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521390.269430:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0600, rc 0) 00000100:00100000:3.0:1788521390.269519:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368119296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521390.269525:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788521390.271725:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521390.271749:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.271760:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521390.271861:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521390.271915:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521390.271957:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4593bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521390.271958:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119424 00000100:00100000:3.0:1788521390.271964:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119424 00000100:00100000:3.0:1788521390.272012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788521390.272021:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368119424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.272290:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368119424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 270us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521390.272305:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788521390.272535:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.272567:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.272605:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521390.272630:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7a886b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521390.272829:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119552 00000100:00100000:3.0:1788521390.272834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119552 00000100:00100000:3.0:1788521390.272857:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788521390.272864:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368119552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.273019:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368119552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521390.273026:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788521390.275914:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.276214:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11692:1875400368119680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521390.276291:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521390.276328:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119680 00000100:00100000:1.0:1788521390.276338:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119680 00000100:00100000:1.0:1788521390.276375:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788521390.276382:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:11692:x1875400368119680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521390.278110:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7a886300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521390.278770:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:11692:x1875400368119680:12345-0@lo:502:llog_process_th.0 Request processed in 2383us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521390.278806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788521390.279315:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11692:1875400368119680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521390.279349:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521390.279358:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521390.279360:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521390.279368:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c0a75d22000 00000020:00000080:3.0:1788521390.279370:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521390.279458:0:11692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11692:1875400368119808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521390.279506:0:11692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521390.279701:0:11692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462456c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521390.279732:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119808 00000100:00100000:3.0:1788521390.279739:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119808 00000100:00100000:3.0:1788521390.279862:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788521390.279873:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:11692:x1875400368119808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521390.283066:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:11692:x1875400368119808:12345-0@lo:502:llog_process_th.0 Request processed in 3187us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521390.283079:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788521390.283227:0:11692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11692:1875400368119808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521390.283268:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521390.283275:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521390.283277:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788521390.283282:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788521390.284035:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788521390.284060:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521390.284070:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521390.284081:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521390.284090:0:5830:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788521390.284092:0:5830:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a4f90d800 from 7 10000000:01000000:1.0:1788521390.284095:0:5830:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788521390.284127:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521390.284134:0:5830:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521390.284143:0:5830:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521390.284163:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.284207:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521390.284247:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48e1a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521390.284511:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368119936 00000100:00100000:2.0:1788521390.284527:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368119936 00000100:00100000:2.0:1788521390.284571:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788521390.284581:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:5830:x1875400368119936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521390.284594:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521390.284606:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a81beae00/0x53df1cebae0165a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0165a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.284641:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a81beae00/0x53df1cebae0165a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0165a2 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.285042:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a81beae00/0x53df1cebae0165a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0165a2 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521390.285052:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beae00, rc 0) 00000100:00100000:2.0:1788521390.285106:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368119936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 527us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521390.285113:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788521390.287524:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368119936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521390.287559:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521390.287571:0:5830:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521390.287655:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368120064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.287709:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521390.287752:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48e1a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521390.287986:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120064 00000100:00100000:3.0:1788521390.287993:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120064 00000100:00100000:3.0:1788521390.288037:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788521390.288046:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368120064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521390.288305:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368120064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521390.288312:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788521390.288597:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368120064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521390.288629:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368120192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521390.288667:0:5830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521390.288697:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521390.289295:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120192 00000100:00100000:1.0:1788521390.289301:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120192 00000100:00100000:1.0:1788521390.289332:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788521390.289339:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368120192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521390.289902:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46227c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:5830:x1875400368120192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 562us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521390.289920:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788521390.290012:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:02b855e8-b82d-4a25-90ff-ed0c016d947b:5830:1875400368120192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521390.297864:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11693:1875400368120320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521390.298633:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521390.298875:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628ab40 going to sleep for 11 seconds 00000040:00080000:2.0:1788521390.299280:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788521390.299418:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120320 00000100:00100000:1.0:1788521390.299427:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120320 00000100:00100000:1.0:1788521390.299471:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788521390.299479:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:11693:x1875400368120320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521390.300183:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:11693:x1875400368120320:12345-0@lo:502:llog_process_th.0 Request processed in 703us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521390.300192:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788521390.300589:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11693:1875400368120320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521390.300624:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521390.300633:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521390.300635:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788521390.300643:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c0a4f90d800 00000020:00000080:0.0:1788521390.300708:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788521390.300891:0:11693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11693:1875400368120448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521390.300946:0:11693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521390.301012:0:11693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521390.301086:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120448 00000100:00100000:2.0:1788521390.301092:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120448 00000100:00100000:2.0:1788521390.301155:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788521390.301163:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:11693:x1875400368120448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521390.301331:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:11693:x1875400368120448:12345-0@lo:502:llog_process_th.0 Request processed in 168us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521390.301339:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788521390.306377:0:11693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:02b855e8-b82d-4a25-90ff-ed0c016d947b:11693:1875400368120448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521390.306432:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521390.306444:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521390.306458:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788521390.306463:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788521390.306577:0:5830:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788521390.306602:0:5830:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788521390.306612:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521390.306623:0:5830:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521391.080942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521391.209037:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521391.209060:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368120576:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.209067:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368120704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521391.209137:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368120832:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.215046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521391.215387:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120704 00000100:00100000:3.0:1788521391.215395:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120704 00000100:00100000:3.0:1788521391.215470:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788521391.215479:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875400368120704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521391.215516:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521391.215563:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1875400368120704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521391.215569:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788521391.217148:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368121216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.217224:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521391.217683:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368120704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521391.217725:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368121088:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.217759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521391.217823:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521391.217830:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368120960:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.217852:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521391.217879:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121088 00000100:00100000:0.0:1788521391.217885:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121088 00000100:00100000:0.0:1788521391.217928:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521391.217937:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368121088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.217982:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368121088:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521391.218005:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521391.218026:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121216 00000100:00100000:0.0:1788521391.218029:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121216 00000100:00100000:0.0:1788521391.218049:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120960 00000100:00100000:0.0:1788521391.218051:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120960 00000100:00100000:0.0:1788521391.218066:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521391.218072:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368121216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.218104:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368121216:12345-0@lo:400:kworker.0 Request processed in 33us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521391.218110:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521391.218119:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521391.218124:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368120960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.218147:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368120960:12345-0@lo:400:kworker.0 Request processed in 23us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521391.218153:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521391.218184:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368120960:0@lo:400:kworker.0 00010000:00080000:0.0:1788521391.218196:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5dc00 x1875400368121088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521391.218205:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368121088:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.218585:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368121216:0@lo:400:kworker.0 00000100:00080000:0.0:1788521391.218629:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788521391.218634:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788521391.218636:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521391.218756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521391.219071:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521391.219111:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120832 00000100:00100000:0.0:1788521391.219117:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120832 00000100:00100000:0.0:1788521391.219165:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788521391.219168:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368120576 00000100:00100000:0.0:1788521391.219174:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368120832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521391.219175:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368120576 00000100:00100000:1.0:1788521391.219229:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788521391.219237:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521391.219273:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368120576:12345-0@lo:400:kworker.0 Request processed in 38us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521391.219280:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788521391.219568:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368120576:0@lo:400:kworker.0 00000100:00100000:0.0:1788521391.220191:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368120832:12345-0@lo:400:kworker.0 Request processed in 1018us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521391.220200:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788521391.220969:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368120832:0@lo:400:kworker.0 00000040:00080000:2.0:1788521391.338869:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788521392.105259:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521392.813856:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1788521393.131695:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521393.261419:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521393.261459:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521393.261695:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066048 00000100:00100000:0.0:1788521393.261705:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066048 00000100:00100000:0.0:1788521393.261840:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:0.0:1788521393.261852:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346066048:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521393.261917:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346066048:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521393.261925:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:2.0:1788521393.262181:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346065920 00000100:00100000:2.0:1788521393.262186:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346065920 00000100:00100000:2.0:1788521393.262224:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 277 00000100:00100000:2.0:1788521393.262232:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346065920:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521393.262271:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346065920:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521393.262277:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 277 00000100:00080000:1.0:1788521393.262397:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521393.262666:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521393.262700:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521393.262875:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066176 00000100:00100000:1.0:1788521393.262880:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066176 00000100:00100000:1.0:1788521393.262934:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1788521393.262942:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346066176:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521393.262979:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346066176:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521393.262986:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00080000:3.0:1788521393.263236:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521393.263389:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066304 00000100:00100000:2.0:1788521393.263394:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066304 00000100:00100000:2.0:1788521393.263442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:2.0:1788521393.263449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346066304:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521393.263495:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346066304:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521393.263502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00080000:3.0:1788521393.263737:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521394.153048:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521394.793249:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521394.793271:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368121344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521394.793341:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521394.793486:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121344 00000100:00100000:3.0:1788521394.793495:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121344 00000100:00100000:3.0:1788521394.793562:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521394.793573:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368121344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521394.793619:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521394.793665:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368121344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521394.793673:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788521394.793674:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788521394.793914:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7ab5dc00 x1875400368121344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521394.793932:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368121344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521395.177145:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521396.201157:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521396.331095:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368121728:0@lo:400:kworker.0 00000100:00100000:0.0:1788521396.331164:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521396.331230:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521396.331237:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368121856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521396.331264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521396.331300:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121856 00000100:00100000:0.0:1788521396.331308:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121856 00000100:00100000:0.0:1788521396.331360:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521396.331386:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368121856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521396.331438:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368121856:12345-0@lo:400:kworker.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521396.331445:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788521396.331476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121728 00000100:00100000:0.0:1788521396.331480:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121728 00000100:00100000:0.0:1788521396.331507:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788521396.331514:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368121728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521396.331548:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368121728:12345-0@lo:400:kworker.0 Request processed in 34us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521396.331554:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:0.0:1788521396.331589:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f2a00 x1875400368121856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521396.331602:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368121856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521396.331612:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368121728:0@lo:400:kworker.0 00000100:00080000:1.0:1788521396.331732:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521396.331736:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521396.331741:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521396.331750:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368122240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521396.331817:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521396.331849:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122240 00000100:00100000:1.0:1788521396.331853:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122240 00000100:00100000:1.0:1788521396.331886:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521396.331900:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368122240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521396.331928:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521396.331962:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368122240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521396.331968:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788521396.331985:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521396.332000:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788521396.332005:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a46419500, transno 4294967300 00000100:00100000:1.0:1788521396.332018:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368122240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521396.332338:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368121600:0@lo:400:kworker.0 00000100:00100000:3.0:1788521396.332371:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521396.332413:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368122112:0@lo:400:kworker.0 00000100:00100000:3.0:1788521396.332432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521396.332458:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788521396.332464:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368121472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521396.332489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521396.332507:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368121984:0@lo:400:kworker.0 00000100:00100000:3.0:1788521396.332525:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521396.332649:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122112 00000100:00100000:0.0:1788521396.332655:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122112 00000100:00100000:0.0:1788521396.332694:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521396.332701:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368122112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521396.332741:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368122112:12345-0@lo:400:kworker.0 Request processed in 40us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521396.332748:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788521396.332806:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368122112:0@lo:400:kworker.0 00000100:00100000:1.0:1788521396.334391:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121600 00000100:00100000:1.0:1788521396.334413:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121600 00000100:00100000:1.0:1788521396.334475:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121984 00000100:00100000:1.0:1788521396.334479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121984 00000100:00100000:1.0:1788521396.334532:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521396.334541:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368121600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521396.334623:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368121600:12345-0@lo:400:kworker.0 Request processed in 82us (2251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521396.334630:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521396.334648:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788521396.334652:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521396.334654:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368121984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521396.334680:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368121984:12345-0@lo:400:kworker.0 Request processed in 27us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521396.334686:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788521396.334690:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368121472 00000100:00100000:2.0:1788521396.334694:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368121472 00000100:00100000:2.0:1788521396.334722:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788521396.334723:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368121984:0@lo:400:kworker.0 00000100:00100000:2.0:1788521396.334729:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368121472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521396.334734:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368121600:0@lo:400:kworker.0 00000100:00100000:2.0:1788521396.334801:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368121472:12345-0@lo:400:kworker.0 Request processed in 46us (2284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521396.334807:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788521396.334807:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368121472:0@lo:400:kworker.0 00010000:00010000:2.0:1788521397.224942:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521398.249477:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521398.385677:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521398.385717:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521398.385843:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521398.385904:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521398.385933:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066432 00000100:00100000:0.0:1788521398.385941:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066432 00000100:00100000:0.0:1788521398.385990:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 279 00000100:00100000:0.0:1788521398.386001:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346066432:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521398.386077:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346066432:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521398.386096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 279 00000100:00100000:0.0:1788521398.386131:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066688 00000100:00100000:0.0:1788521398.386135:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066688 00000100:00100000:0.0:1788521398.386173:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1788521398.386180:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346066688:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521398.386218:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346066688:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521398.386225:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:1.0:1788521398.386402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066560 00000100:00100000:1.0:1788521398.386407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066560 00000100:00100000:1.0:1788521398.386441:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066816 00000100:00100000:1.0:1788521398.386444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066816 00000100:00100000:1.0:1788521398.386466:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:1.0:1788521398.386474:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346066560:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521398.386504:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346066560:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521398.386510:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:1.0:1788521398.386525:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1788521398.386531:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346066816:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521398.386554:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346066816:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521398.386561:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00080000:2.0:1788521398.387822:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521398.387845:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788521399.272955:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521399.914580:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521399.914605:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368122368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521399.914673:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521399.915054:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122368 00000100:00100000:3.0:1788521399.915070:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122368 00000100:00080000:2.0:1788521399.915182:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521399.915220:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521399.915231:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368122368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521399.915272:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521399.915325:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368122368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521399.915332:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788521399.915398:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a48f5bb80 x1875400368122368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521399.915417:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368122368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521400.297766:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521401.320953:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521401.449052:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368122752:0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.449121:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521401.449237:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368122496:0@lo:400:kworker.0 00000100:00100000:0.0:1788521401.449277:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521401.449279:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368122624:0@lo:400:kworker.0 00000100:00100000:1.0:1788521401.449322:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521401.449371:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122752 00000100:00100000:1.0:1788521401.449378:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122752 00000100:00100000:1.0:1788521401.449440:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122624 00000100:00100000:1.0:1788521401.449443:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122624 00000100:00100000:1.0:1788521401.449467:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521401.449476:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368122752:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788521401.449527:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521401.449568:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788521401.449577:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368122624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521401.449614:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368122624:12345-0@lo:400:kworker.0 Request processed in 39us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521401.449621:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788521401.452740:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368123264:0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.452825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521401.453694:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122496 00000100:00100000:2.0:1788521401.453704:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122496 00000100:00100000:2.0:1788521401.453769:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788521401.453793:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368122496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521401.453878:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46226450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368122496:12345-0@lo:400:kworker.0 Request processed in 89us (4601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521401.453928:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368122752:12345-0@lo:400:kworker.0 Request processed in 4452us (4805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521401.453958:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521401.454012:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368123136:0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.454029:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368122752:0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.454052:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521401.454052:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521401.454062:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368122880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521401.454095:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368122624:0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.454101:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521401.454115:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521401.454125:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368123008:0@lo:400:kworker.0 00000100:00100000:1.0:1788521401.454151:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521401.454192:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123264 00000100:00100000:1.0:1788521401.454197:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123264 00000100:00100000:1.0:1788521401.454234:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123008 00000100:00100000:1.0:1788521401.454237:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123008 00000100:00100000:1.0:1788521401.454257:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521401.454263:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368123264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.454287:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521401.454300:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368123008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521401.454305:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368123264:12345-0@lo:400:kworker.0 Request processed in 39us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521401.454314:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788521401.454348:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521401.454352:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521401.454364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123136 00000100:00100000:1.0:1788521401.454367:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123136 00000100:00100000:3.0:1788521401.454395:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368123008:12345-0@lo:400:kworker.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521401.454402:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788521401.454407:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521401.454430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368122880 00000100:00100000:3.0:1788521401.454434:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368122880 00000100:00100000:3.0:1788521401.454459:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521401.454465:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368122880:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521401.454484:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368123136:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788521401.454492:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521401.454526:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368123136:12345-0@lo:400:kworker.0 Request processed in 113us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521401.454533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:1.0:1788521401.454550:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521401.454616:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00080000:1.0:1788521401.455758:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6dfb4000 x1875400368123008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521401.455797:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368123008:0@lo:400:kworker.0 00000100:00100000:1.0:1788521401.455814:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368123136:0@lo:400:kworker.0 00000100:00100000:1.0:1788521401.455883:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368122496:0@lo:400:kworker.0 00000100:00100000:1.0:1788521401.459409:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368122880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521401.459430:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368123264:0@lo:400:kworker.0 00000100:00100000:3.0:1788521401.459509:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368122880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5042us (5409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521401.459519:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:2.0:1788521401.577439:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788521402.345074:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521403.368953:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521403.509091:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521403.509142:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521403.509346:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346066944 00000100:00100000:2.0:1788521403.509357:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346066944 00000100:00100000:2.0:1788521403.509428:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 281 00000100:00100000:2.0:1788521403.509439:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346066944:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521403.509516:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346066944:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 79us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521403.509524:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 281 00000100:00100000:1.0:1788521403.509604:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067072 00000100:00100000:1.0:1788521403.509609:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067072 00000100:00100000:1.0:1788521403.509669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:1.0:1788521403.509677:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346067072:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521403.509721:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346067072:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 45us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521403.509727:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00080000:2.0:1788521403.509854:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521403.515850:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521403.515907:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521403.516043:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067328 00000100:00100000:0.0:1788521403.516054:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067328 00000100:00100000:0.0:1788521403.516134:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:0.0:1788521403.516145:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346067328:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:2.0:1788521403.516310:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521403.516495:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346067328:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 73us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521403.516504:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:3.0:1788521403.516647:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067200 00000100:00100000:3.0:1788521403.516653:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067200 00000100:00100000:3.0:1788521403.516712:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1788521403.516720:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2344:x1875400346067200:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:3.0:1788521403.516740:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0164e5 00000100:00080000:3.0:1788521403.516750:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a45733800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521403.516806:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788521403.517107:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788521403.517127:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521403.517458:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+2:2344:x1875400346067200:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 736us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521403.517466:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:2.0:1788521404.393049:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521405.039761:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521405.044123:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368123392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521405.044218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521405.044537:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123392 00000100:00100000:1.0:1788521405.044547:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123392 00000100:00100000:1.0:1788521405.044622:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788521405.044630:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368123392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521405.044665:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521405.044729:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368123392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521405.044736:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788521405.044820:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a48f59500 x1875400368123392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521405.044849:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368123392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521405.048994:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521405.417012:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521406.441113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521406.569111:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368123520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521406.569192:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521406.569350:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123520 00000100:00100000:1.0:1788521406.569358:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123520 00000100:00100000:1.0:1788521406.569430:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788521406.569440:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368123520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521406.569476:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521406.569520:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368123520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521406.569527:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788521406.569648:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521406.569699:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368123520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521406.570402:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368123776:0@lo:400:kworker.0 00000100:00100000:3.0:1788521406.570454:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521406.570488:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521406.570494:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368123904:0@lo:400:kworker.0 00000100:00100000:3.0:1788521406.570519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521406.570561:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123776 00000100:00100000:3.0:1788521406.570568:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123776 00000100:00100000:2.0:1788521406.570589:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123904 00000100:00100000:2.0:1788521406.570595:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123904 00000100:00100000:3.0:1788521406.570615:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788521406.570626:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521406.570638:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788521406.570650:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368123904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521406.570678:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368123776:12345-0@lo:400:kworker.0 Request processed in 54us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521406.570711:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368123904:12345-0@lo:400:kworker.0 Request processed in 63us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521406.570721:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788521406.570763:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368123904:0@lo:400:kworker.0 00000100:00100000:0.0:1788521406.570766:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368124032:0@lo:400:kworker.0 00000100:00100000:3.0:1788521406.570801:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368123776:0@lo:400:kworker.0 00000100:00100000:0.0:1788521406.570827:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788521406.570835:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521406.570855:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788521406.570861:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368123648:0@lo:400:kworker.0 00000100:00100000:0.0:1788521406.570886:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521406.570923:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368124160:0@lo:400:kworker.0 00000100:00100000:0.0:1788521406.570945:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521406.570968:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368123648 00000100:00100000:3.0:1788521406.570974:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368123648 00000100:00100000:0.0:1788521406.570981:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124032 00000100:00100000:0.0:1788521406.570987:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124032 00000100:00100000:3.0:1788521406.571011:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788521406.571020:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368123648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521406.571032:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788521406.571049:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368124032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521406.571075:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46225850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368123648:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521406.571082:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788521406.571107:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368124032:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521406.571114:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788521406.571130:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124160 00000100:00100000:3.0:1788521406.571135:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124160 00000100:00100000:0.0:1788521406.571158:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368123648:0@lo:400:kworker.0 00010000:00080000:0.0:1788521406.571733:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f5f1500 x1875400368124032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521406.571745:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368124032:0@lo:400:kworker.0 00000100:00080000:0.0:1788521406.571807:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521406.578831:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788521406.579261:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788521406.579284:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368124160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521406.579401:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368124160:12345-0@lo:400:kworker.0 Request processed in 130us (8454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521406.579408:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788521406.579524:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368124160:0@lo:400:kworker.0 00010000:00010000:2.0:1788521407.465483:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788521408.178342:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:3.0:1788521408.178352:0:7652:0:(genops.c:885:class_export_put()) final put ffff8c0a45732800/0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:0.0:1788521408.178552:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a45732800/0ec78abe-db90-4086-b379-6c867e47751e for lustre-OST0001 00000020:00000080:0.0:1788521408.178611:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a45733800 for lustre-OST0001 00010000:00010000:2.0:1788521408.489003:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521408.620686:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521408.620749:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521408.620852:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521408.620880:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067456 00000100:00100000:0.0:1788521408.620898:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067456 00000100:00100000:0.0:1788521408.621106:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 283 00000100:00100000:0.0:1788521408.621119:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346067456:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521408.621203:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346067456:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 88us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521408.621211:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 283 00000100:00100000:2.0:1788521408.621320:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067712 00000100:00100000:2.0:1788521408.621330:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067712 00000100:00100000:2.0:1788521408.621397:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067584 00000100:00100000:2.0:1788521408.621401:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067584 00000100:00100000:2.0:1788521408.621433:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1788521408.621443:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346067712:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521408.621516:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346067712:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521408.621524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1788521408.621543:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:2.0:1788521408.621563:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2346:x1875400346067584:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521408.621601:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2346:x1875400346067584:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521408.621607:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00080000:0.0:1788521408.622153:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788521409.513165:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521410.154019:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521410.154052:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368124288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521410.154130:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521410.154256:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124288 00000100:00100000:3.0:1788521410.154267:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124288 00000100:00100000:3.0:1788521410.154361:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788521410.154371:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368124288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521410.154407:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521410.154456:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368124288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521410.154463:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788521410.154524:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a48f59f80 x1875400368124288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521410.154541:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368124288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788521410.156123:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788521410.539455:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521411.562700:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521411.689521:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368124416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521411.689620:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521411.689736:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124416 00000100:00100000:1.0:1788521411.689747:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124416 00000100:00100000:1.0:1788521411.689839:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788521411.689850:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368124416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521411.689900:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521411.689956:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368124416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521411.689964:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788521411.689990:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521411.690039:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368124416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521411.697312:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368124544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.697408:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521411.697456:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368125056:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.697486:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521411.697516:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521411.697522:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368124672:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.697544:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521411.697758:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124544 00000100:00100000:2.0:1788521411.697768:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124544 00000100:00100000:2.0:1788521411.697930:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788521411.697942:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368124544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698001:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3300:x1875400368124544:12345-0@lo:400:kworker.0 Request processed in 62us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521411.698010:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788521411.698061:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368125056 00000100:00100000:2.0:1788521411.698064:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368125056 00000100:00100000:2.0:1788521411.698106:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124672 00000100:00100000:2.0:1788521411.698109:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124672 00000100:00100000:2.0:1788521411.698133:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788521411.698139:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698191:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368125056:12345-0@lo:400:kworker.0 Request processed in 52us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521411.698198:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788521411.698213:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521411.698219:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368124672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698246:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368124672:12345-0@lo:400:kworker.0 Request processed in 28us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521411.698253:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788521411.698514:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368124672:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698525:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368124544:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698535:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368125056:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698572:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368124800:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521411.698623:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521411.698630:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368124928:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698669:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521411.698696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124800 00000100:00100000:2.0:1788521411.698699:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124800 00000100:00100000:2.0:1788521411.698727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788521411.698734:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368124800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.698767:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368124800:12345-0@lo:400:kworker.0 Request processed in 34us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521411.698797:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788521411.698819:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368124928 00000100:00080000:1.0:1788521411.699211:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521411.700970:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368124928 00000100:00100000:2.0:1788521411.701073:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521411.701087:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368124928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.701197:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368124928:12345-0@lo:400:kworker.0 Request processed in 114us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521411.701204:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788521411.701267:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a6dfb6a00 x1875400368124928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788521427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521411.701287:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368124928:0@lo:400:kworker.0 00000100:00100000:2.0:1788521411.701303:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368124800:0@lo:400:kworker.0 00000040:00080000:3.0:1788521411.829723:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788521412.381173:0:11860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:30:10 (1788521410) 00010000:00010000:2.0:1788521412.584953:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521413.608993:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521413.789066:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521413.789123:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521413.789341:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067840 00000100:00100000:3.0:1788521413.789355:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067840 00000100:00100000:3.0:1788521413.789559:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 285 00000100:00100000:3.0:1788521413.789573:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346067840:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521413.789696:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346067840:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 126us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521413.789705:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 285 00000100:00100000:1.0:1788521413.792197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346068096 00000100:00100000:1.0:1788521413.792227:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346068096 00000100:00100000:1.0:1788521413.792382:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:1.0:1788521413.792401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346068096:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521413.792547:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346068096:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 153us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521413.792556:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00080000:2.0:1788521413.793282:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521413.807387:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521413.808004:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346067968 00000100:00100000:0.0:1788521413.808019:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346067968 00000100:00100000:0.0:1788521413.808122:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:0.0:1788521413.808135:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346067968:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:2.0:1788521413.808334:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521413.808661:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346067968:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 525us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521413.808691:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:0.0:1788521414.022866:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521414.023033:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346068224 00000100:00100000:1.0:1788521414.023048:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346068224 00000100:00100000:1.0:1788521414.023123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:1.0:1788521414.023134:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:10213:x1875400346068224:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521414.023161:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521414.023189:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae0165b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644034d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521414.023283:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae0165b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521414.023301:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae0165b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521414.023318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae0165b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521414.023362:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521414.023366:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521414.023410:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae0165b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521414.023435:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae0165b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644034d expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521414.023475:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae0165b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644034d expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521414.023485:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:1.0:1788521414.023488:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521414.023492:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521414.024058:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:10213:x1875400346068224:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 923us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521414.024067:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1788521414.036816:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521414.036942:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346068352 00000100:00100000:0.0:1788521414.036951:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346068352 00000100:00100000:0.0:1788521414.037015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1788521414.037025:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:10214:x1875400346068352:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521414.037043:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521414.037065:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae0165be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440354 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037140:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037156:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037169:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037186:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037193:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037200:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037615:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4200/0x53df1cebae0165d3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037644:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4200/0x53df1cebae0165d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037653:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4200/0x53df1cebae0165d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521414.037683:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788521414.037687:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521414.037710:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4200/0x53df1cebae0165d3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037720:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037726:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037731:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037737:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82044e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521414.037741:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037748:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037761:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:0.0:1788521414.037764:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521414.037768:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037822:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0165c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037838:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037844:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037849:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037853:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82045a00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521414.037856:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037861:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037869:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c0a4fa31900) 00010000:00010000:0.0:1788521414.037872:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521414.037875:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037881:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0165cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037913:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae0165be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440354 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037927:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4200/0x53df1cebae0165d3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440354 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521414.037939:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c0a4fa31600) 00010000:00010000:0.0:1788521414.037941:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521414.037944:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4200, rc 0) 00000100:00100000:0.0:1788521414.038026:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:10214:x1875400346068352:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1001us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521414.038033:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:2.0:1788521414.044388:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521414.046230:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346068608 00000100:00100000:3.0:1788521414.046245:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346068608 00000100:00100000:3.0:1788521414.046330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1788521414.046341:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:10214:x1875400346068608:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521414.046361:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521414.046385:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0165da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644035b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046491:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046505:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046516:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046568:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046577:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046584:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046956:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0165ef lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046965:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0165ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.046973:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0165ef lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521414.046982:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788521414.047136:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047143:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047157:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047163:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521414.047167:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047175:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047187:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c0a4fa31600) 00010000:00010000:3.0:1788521414.047190:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521414.047194:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047200:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0165e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047213:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047220:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047226:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047231:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521414.047234:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047248:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047257:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521414.047259:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521414.047262:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047267:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047724:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0165da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644035b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047740:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0165ef lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644035b expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521414.047748:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:3.0:1788521414.047751:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521414.047753:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1a00, rc 0) 00000100:00100000:3.0:1788521414.047852:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+9:10214:x1875400346068608:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1512us (3477us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788521414.047861:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:2.0:1788521414.057594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521414.057811:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346068736 00000100:00100000:1.0:1788521414.057824:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346068736 00000100:00100000:1.0:1788521414.057887:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1788521414.057898:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+9:10214:x1875400346068736:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788521414.058002:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+9:10214:x1875400346068736:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 106us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521414.058010:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00010000:00010000:3.0:1788521414.633558:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521414.890454:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788521415.273258:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368125184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521415.273379:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521415.273840:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368125184 00000100:00100000:1.0:1788521415.273854:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368125184 00000100:00100000:1.0:1788521415.273947:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788521415.273960:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368125184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521415.274026:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521415.274127:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521415.276983:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368125184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3007us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521415.277001:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:3.0:1788521415.278612:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a48f5a300 x1875400368125184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521415.278692:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368125184:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521415.656931:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521416.309824:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.310124:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346068864 00000100:00100000:3.0:1788521416.310137:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346068864 00000100:00100000:3.0:1788521416.310209:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1788521416.310220:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+9:10256:x1875400346068864:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521416.310239:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521416.310269:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440362 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310348:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310361:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310375:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310389:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310397:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310404:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310642:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310663:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310669:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310675:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521416.310679:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310685:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310699:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521416.310702:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521416.310707:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310714:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016604 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310727:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310733:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310740:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310746:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521416.310755:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310761:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310770:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521416.310792:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521416.310796:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310802:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01660b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310839:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440362 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310850:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521416.310852:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521416.310855:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0165fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440362 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.310865:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521416.310933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+9:10256:x1875400346068864:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 716us (1122us total) trans 0 rc 301/301 00000100:00100000:3.0:1788521416.310941:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00080000:0.0:1788521416.311165:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521416.321884:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.322300:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346069120 00000100:00100000:3.0:1788521416.322315:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346069120 00000100:00100000:3.0:1788521416.322382:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1788521416.322394:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+9:10256:x1875400346069120:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:3.0:1788521416.322489:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521416.322526:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae0165b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644034d expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.322551:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521416.322564:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521416.323287:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.323309:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.323322:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.323335:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.323341:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.323347:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521416.327540:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788521416.327577:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.327591:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.327600:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.327638:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521416.327645:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.327654:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.327678:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521416.327681:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521416.327688:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.327696:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016612 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521416.327726:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a52ec293 reply state 000000002668ee1f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521416.327737:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521416.327999:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+10:10256:x1875400346069120:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 5598us (6224us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788521416.328010:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00010000:00010000:2.0:1788521416.336961:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.336996:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.337004:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.337011:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521416.337016:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.337024:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.337043:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c0a65ff4700) 00010000:00010000:2.0:1788521416.337047:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521416.337052:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.337059:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016619 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521416.441582:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.441815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346069248 00000100:00100000:3.0:1788521416.441827:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346069248 00000100:00100000:1.0:1788521416.442385:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1788521416.442417:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+9:10264:x1875400346069248:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:1.0:1788521416.442442:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521416.442479:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440369 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.442551:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.442564:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.442576:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521416.442610:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521416.442622:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521416.442663:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.442690:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440369 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.442708:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440369 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.442716:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521416.442720:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521416.442723:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b400, rc 0) 00000100:00100000:1.0:1788521416.442830:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:10264:x1875400346069248:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 418us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521416.442847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1788521416.530749:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521416.534927:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346069376 00000100:00100000:0.0:1788521416.534944:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346069376 00000100:00100000:0.0:1788521416.535026:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1788521416.535036:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+10:10270:x1875400346069376:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1788521416.535054:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521416.535076:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01662e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440370 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535140:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535156:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535168:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535182:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535210:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535218:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535319:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae016643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.535327:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae016643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536028:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae016643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521416.536065:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788521416.536068:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521416.536108:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae016643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536120:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536127:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536134:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536140:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521416.536144:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536162:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536176:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:0.0:1788521416.536179:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521416.536184:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536189:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536205:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536210:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536216:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536222:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521416.536224:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536229:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536236:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c0a4fa31a00) 00010000:00010000:0.0:1788521416.536238:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521416.536240:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536256:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01663c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536295:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01662e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440370 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536308:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae016643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440370 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.536315:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521416.536318:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788521416.536320:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82044200, rc 0) 00000100:00100000:0.0:1788521416.539750:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+11:10270:x1875400346069376:12345-192.168.203.48@tcp:101:bash.0 Request processed in 4700us (8995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.539762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1788521416.544658:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.545539:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346069632 00000100:00100000:1.0:1788521416.545553:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346069632 00000100:00100000:1.0:1788521416.545635:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1788521416.545647:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+11:10270:x1875400346069632:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521416.545667:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521416.545691:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae01664a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440377 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.546065:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.546081:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.546093:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.546146:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.546155:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.546162:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521416.553152:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788521416.553374:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553404:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553418:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553459:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553465:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553472:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553478:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521416.553483:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553491:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553503:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521416.553506:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521416.553512:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553518:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016651 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521416.553533:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064adb28d reply state 00000000aa43f6e0 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521416.553549:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521416.553597:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae01664a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553622:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.553630:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:1.0:1788521416.553633:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521416.553636:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b200, rc 0) 00000100:00100000:1.0:1788521416.553720:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:10270:x1875400346069632:12345-192.168.203.48@tcp:101:bash.0 Request processed in 8075us (9073us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788521416.553729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00010000:00010000:3.0:1788521416.555663:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.555686:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.555695:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.555718:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521416.555724:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.555745:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.555971:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521416.555976:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521416.555982:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.555989:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016658 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521416.560103:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.560194:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346069760 00000100:00100000:1.0:1788521416.560213:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346069760 00000100:00100000:1.0:1788521416.560347:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521416.560358:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875400346069760:12345-192.168.203.48@tcp:8:bash.0 00010000:00080000:1.0:1788521416.560420:0:8219:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp t0 exp 0000000000000000 cur 337 last 0 00000020:00000080:1.0:1788521416.560465:0:8219:0:(genops.c:1385:class_connect()) connect: client 0ec78abe-db90-4086-b379-6c867e47751e, cookie 0x53df1cebae01666d 00002000:00100000:1.0:1788521416.560478:0:8219:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0ec78abe-db90-4086-b379-6c867e47751e/ffff8c0a7f1d5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788521416.560489:0:8219:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788521416.560733:0:8219:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788521416.560765:0:8219:0:(import.c:65:import_set_state_nolock()) ffff8c0a608db000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521416.560892:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2344:x1875400346069760:12345-192.168.203.48@tcp:8:bash.0 Request processed in 535us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521416.560909:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1788521416.578213:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.578407:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346069888 00000100:00100000:3.0:1788521416.578422:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346069888 00000100:00080000:0.0:1788521416.578621:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521416.578756:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1788521416.578970:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:0:x1875400346069888:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521416.579001:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521416.579041:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644037e expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521416.579081:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521416.579220:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1788521416.579227:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521416.579243:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.579293:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.579312:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521416.579445:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:0:x1875400346069888:12345-192.168.203.48@tcp:101:bash.0 Request processed in 677us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521416.579454:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1788521416.595436:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521416.595563:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346070016 00000100:00100000:0.0:1788521416.595577:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346070016 00000100:00100000:0.0:1788521416.595656:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1788521416.595667:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:10270:x1875400346070016:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1788521416.595689:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521416.595715:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440385 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.595755:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.595821:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521416.595827:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521416.595834:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.595881:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.595898:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521416.595914:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75413480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875400368125312:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521416.596100:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521416.601560:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75413480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875400368125312:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521416.601621:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.601650:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045a00, rc 0) 00000100:00100000:3.0:1788521416.602455:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521416.602876:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:10270:x1875400346070016:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7207us (7452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.602889:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1788521416.603001:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346070144 00000100:00100000:1.0:1788521416.603011:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346070144 00010000:00010000:1.0:1788521416.603060:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521416.603093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1788521416.603103:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346070144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521416.603120:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521416.603148:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.603165:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.603195:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae016674 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644037e expref: 8 pid: 6690 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.603218:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521416.603223:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521416.603235:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.603246:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.603313:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521416.603331:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875400368125440:192.168.203.48@tcp:105: 00000100:00100000:1.0:1788521416.603416:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521416.609196:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521416.609739:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346070400 00000100:00100000:2.0:1788521416.609752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346070400 00000100:00100000:2.0:1788521416.609873:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1788521416.609885:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:10270:x1875400346070400:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:2.0:1788521416.610352:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:10270:x1875400346070400:12345-192.168.203.48@tcp:35:bash.0 Request processed in 467us (1170us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788521416.610374:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1788521416.611046:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875400368125440:192.168.203.48@tcp:105: 00010000:00010000:1.0:1788521416.611084:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521416.611133:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346070144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 8030us (8684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521416.611143:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00010000:00010000:3.0:1788521416.681971:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521416.685117:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.686119:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346070656 00000100:00100000:1.0:1788521416.686137:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346070656 00000100:00100000:1.0:1788521416.686231:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1788521416.686244:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+14:10280:x1875400346070656:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521416.686276:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521416.686304:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016682 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644038c expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521416.686426:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788521416.686599:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016682 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644038c expref: 16 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.686632:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521416.686636:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521416.686658:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016682 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644038c expref: 16 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.686677:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b800, rc 0) 00000100:00100000:1.0:1788521416.686850:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+15:10280:x1875400346070656:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 608us (1747us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788521416.686858:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1788521416.692490:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521416.692677:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346070912 00000100:00100000:2.0:1788521416.692690:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346070912 00000100:00100000:2.0:1788521416.692961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1788521416.692974:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+15:10280:x1875400346070912:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521416.695636:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+16:10280:x1875400346070912:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 2630us (3125us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788521416.695655:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1788521416.793219:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521416.793342:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346071040 00000100:00100000:0.0:1788521416.793355:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346071040 00000100:00100000:0.0:1788521416.793427:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1788521416.793453:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+16:10286:x1875400346071040:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521416.793486:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521416.793516:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae016690 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440393 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.793604:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.793631:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.793645:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521416.793691:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788521416.793695:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521416.793722:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.793755:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae016690 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440393 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.793988:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440393 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.794000:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521416.794003:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521416.794007:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4000, rc 0) 00000100:00100000:0.0:1788521416.794077:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+17:10286:x1875400346071040:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 625us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.794094:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1788521416.800305:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.800441:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346071296 00000100:00100000:1.0:1788521416.800455:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346071296 00000100:00100000:1.0:1788521416.800528:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1788521416.800540:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+17:10286:x1875400346071296:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521416.800570:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521416.800599:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae01669e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644039a expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.800758:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0166a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.800822:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0166a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.800838:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0166a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521416.800853:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788521416.801051:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae01669e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644039a expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.801072:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0166a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644039a expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.801096:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:1.0:1788521416.801099:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521416.801104:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575aa00, rc 0) 00000100:00100000:1.0:1788521416.801202:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+19:10286:x1875400346071296:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 663us (911us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788521416.801211:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:3.0:1788521416.804998:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.805041:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.807691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346071552 00000100:00100000:1.0:1788521416.807713:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346071552 00000100:00100000:1.0:1788521416.808063:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1788521416.808078:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:10286:x1875400346071552:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521416.808113:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521416.808144:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0166b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403a1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.808273:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0166ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.808294:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0166ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.808307:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0166ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521416.808322:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788521416.808483:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0166b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a1 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.808525:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0166ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a1 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.808535:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:1.0:1788521416.808538:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788521416.808542:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b600, rc 0) 00000100:00100000:1.0:1788521416.808764:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+21:10286:x1875400346071552:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 688us (3778us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788521416.808808:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1788521416.809317:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346071680 00000100:00100000:0.0:1788521416.809326:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346071680 00000100:00100000:0.0:1788521416.809375:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1788521416.809384:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:2348:x1875400346071680:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521416.809397:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521416.809417:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0166a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644039a expref: 21 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.809432:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:0.0:1788521416.809436:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521416.809469:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:2348:x1875400346071680:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 86us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.809475:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:3.0:1788521416.810505:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368125568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521416.810591:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521416.812415:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368125568 00000100:00100000:1.0:1788521416.812432:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368125568 00000100:00100000:1.0:1788521416.812529:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788521416.812541:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368125568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521416.812591:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521416.812702:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368125568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521416.812711:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788521416.812799:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521416.812953:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368125568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521416.828238:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368125696:0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.828337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521416.828441:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368125696 00000100:00100000:2.0:1788521416.828452:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368125696 00000100:00100000:2.0:1788521416.828524:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788521416.828535:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368125696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521416.828943:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368125696:12345-0@lo:400:kworker.0 Request processed in 409us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521416.828952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788521416.829007:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368125824:0@lo:400:kworker.0 00000100:00100000:2.0:1788521416.829039:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521416.829102:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521416.829109:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368125952:0@lo:400:kworker.0 00000100:00100000:2.0:1788521416.829135:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521416.829201:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368125696:0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.829219:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521416.829225:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368126080:0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.829256:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521416.829291:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368126080 00000100:00100000:0.0:1788521416.829296:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368126080 00000100:00100000:0.0:1788521416.829332:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521416.829339:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368126080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.829396:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368126080:12345-0@lo:400:kworker.0 Request processed in 57us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.829402:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521416.829436:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368126080:0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.829596:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368126208:0@lo:400:kworker.0 00000100:00100000:3.0:1788521416.829793:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521416.829833:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368125824 00000100:00100000:1.0:1788521416.829839:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368125824 00000100:00100000:0.0:1788521416.830054:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368125952 00000100:00100000:0.0:1788521416.830059:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368125952 00000100:00100000:0.0:1788521416.830099:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788521416.830106:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368125824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.830154:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368125824:12345-0@lo:400:kworker.0 Request processed in 48us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.830161:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788521416.830178:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788521416.830184:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368125952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.830213:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368125952:12345-0@lo:400:kworker.0 Request processed in 30us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.830219:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788521416.830248:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368125952:0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.830257:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368125824:0@lo:400:kworker.0 00000100:00080000:2.0:1788521416.830317:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521416.830447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368126208 00000100:00100000:0.0:1788521416.830452:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368126208 00000100:00100000:0.0:1788521416.830502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788521416.830509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368126208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521416.830546:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368126208:12345-0@lo:400:kworker.0 Request processed in 38us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.830563:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1788521416.830620:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521416.830676:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368126208:0@lo:400:kworker.0 00000100:00100000:3.0:1788521416.832224:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.834920:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346071808 00000100:00100000:1.0:1788521416.834941:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346071808 00000100:00100000:1.0:1788521416.835019:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1788521416.835031:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2348:x1875400346071808:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:1.0:1788521416.835106:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.835161:0:8219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.835171:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521416.835176:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521416.835181:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.835228:0:8219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.835245:0:8219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521416.835263:0:8219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8219:1875400368126336:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521416.835380:0:8219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a412ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1788521416.840592:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.840861:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346071936 00000100:00100000:3.0:1788521416.840873:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346071936 00002000:00100000:3.0:1788521416.840924:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8c0a6052a680 x1875400346071936/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:417/0 lens 504/0 e 0 to 0 dl 1788521427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521416.840955:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6052a680 with x1875400346071936 ext(0->12) 00010000:00010000:3.0:1788521416.840965:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 8 pid: 6693 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.840982:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 8 pid: 6693 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521416.840990:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a6052a680 00000100:00100000:3.0:1788521416.841037:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521416.841048:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346071936:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:1.0:1788521416.841383:0:8219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8219:1875400368126336:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521416.841426:0:8219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788521416.923222:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000001:00080000:1.0:1788521416.958902:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788521416.959519:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346071936:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 118462us (118927us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788521416.959539:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00002000:00100000:0.0:1788521416.959556:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8c0a6052a680 x1875400346071936/t4294967299(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:417/0 lens 504/448 e 0 to 0 dl 1788521427 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521416.959567:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6052a680 with x1875400346071936 ext(0->12) 00010000:00010000:0.0:1788521416.959580:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.959603:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521416.959621:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a6052a680 00000100:00100000:3.0:1788521416.963516:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.963802:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346072064 00000100:00100000:1.0:1788521416.963814:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346072064 00010000:00010000:1.0:1788521416.963878:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521416.963965:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:1.0:1788521416.963975:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346072064:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521416.963993:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788521416.964015:0:8520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788521416.964018:0:8520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788521416 00002000:00010000:1.0:1788521416.964020:0:8520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788521416 00002000:00010000:1.0:1788521416.964023:0:8520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788521416 00002000:00010000:1.0:1788521416.964025:0:8520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1788521416.964031:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.964044:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.964070:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000389239a8/0x53df1cebae01667b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440385 expref: 7 pid: 6693 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.964090:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788521416.964094:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521416.964101:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.964112:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.964161:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521416.964300:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346072064:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 326us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521416.964309:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00010000:00010000:3.0:1788521416.964662:0:8219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964673:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964699:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964708:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964715:0:8219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964744:0:8219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521416.964749:0:8219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964760:0:8219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964792:0:8219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.964802:0:8219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae0166c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521416.964866:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346071808:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 129837us (132654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521416.964875:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:3.0:1788521416.969011:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521416.969145:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346072320 00000100:00100000:2.0:1788521416.969177:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346072320 00000100:00100000:2.0:1788521416.969237:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:2.0:1788521416.969247:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:10286:x1875400346072320:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:2.0:1788521416.969322:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0166ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a1 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521416.969674:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788521416.969730:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788521416.970287:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788521416.970349:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.970367:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.970377:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.970412:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.970427:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 24 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521416.970442:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a60528a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875400368126464:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521416.970530:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521416.983717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521416.983851:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a60528a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875400368126464:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521416.983881:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521416.984251:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346072448 00000100:00100000:0.0:1788521416.984259:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346072448 00010000:00010000:0.0:1788521416.984296:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 25 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521416.984335:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:0.0:1788521416.984345:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+25:2345:x1875400346072448:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521416.984359:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521416.984366:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 25 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.984401:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 25 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.984425:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01665f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440377 expref: 25 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.984442:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:0.0:1788521416.984447:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.984457:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.984464:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521416.984497:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521416.984619:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521416.984638:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521416.984805:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788521416.985020:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788521416.985149:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6052aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368126592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521416.985200:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521416.985224:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521416.985330:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368126592 00000100:00100000:3.0:1788521416.985337:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368126592 00000100:00100000:3.0:1788521416.985382:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521416.985390:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875400368126592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788521416.985469:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875400368126592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521416.985476:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521416.985514:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6052aa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368126592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788521416.986179:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788521416.986256:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7accb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368126720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788521416.986292:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521416.986312:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521416.986328:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368126720 00000100:00100000:3.0:1788521416.986332:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368126720 00000100:00100000:3.0:1788521416.986356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521416.986363:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875400368126720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788521416.986544:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875400368126720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 181us (251us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788521416.986551:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521416.986585:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7accb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368126720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788521416.986637:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788521416.986671:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.986681:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.986689:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.986695:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521416.986707:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.986716:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.986733:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:3.0:1788521416.986736:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788521416.986741:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521416.986748:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0166cf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521416.986983:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788521416.987188:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788521416.987199:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338065424942ns, next at 339065422925ns, rc = 0 00000001:00080000:3.0:1788521416.987206:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788521416.987237:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ca00) 00010000:00010000:3.0:1788521416.987240:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521416.987247:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0166ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a1 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521416.987441:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+28:2345:x1875400346072448:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 3095us (3734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521416.987451:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1788521416.988102:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+27:10286:x1875400346072320:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 18854us (19102us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788521416.988112:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000020:00080000:3.0:1788521416.988116:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788521416.991336:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521416.991434:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346072576 00000100:00100000:1.0:1788521416.991445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346072576 00000100:00100000:1.0:1788521416.991540:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:1.0:1788521416.991550:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+27:10286:x1875400346072576:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521416.991578:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521416.991624:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0166d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403a8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.991691:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0166d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a8 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.991706:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0166d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a8 expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521416.991724:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521416.991738:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521416.991742:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a000, rc 0) 00000100:00100000:1.0:1788521416.992078:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+28:10286:x1875400346072576:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 527us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521416.992085:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:1.0:1788521417.008095:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521417.008263:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346072832 00000100:00100000:2.0:1788521417.008273:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346072832 00000100:00100000:2.0:1788521417.008340:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521417.008346:0:5835:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788521417.008350:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a8a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+28:10286:x1875400346072832:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521417.008355:0:5835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1788521417.008564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a8a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+29:10286:x1875400346072832:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 216us (477us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788521417.008572:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1788521417.124398:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521417.124588:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346073088 00000100:00100000:3.0:1788521417.124599:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346073088 00000100:00100000:3.0:1788521417.124832:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1788521417.124844:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+29:10296:x1875400346073088:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521417.124867:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521417.124890:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0166dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403af expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521417.125123:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788521417.125305:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0166dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403af expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.125319:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:3.0:1788521417.125323:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521417.125327:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0166dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403af expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.125342:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1000, rc 0) 00000100:00100000:3.0:1788521417.125403:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+30:10296:x1875400346073088:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 562us (1017us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788521417.125410:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1788521417.129243:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521417.129582:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346073216 00000100:00100000:3.0:1788521417.129591:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346073216 00000100:00100000:3.0:1788521417.129666:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1788521417.129677:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+30:10296:x1875400346073216:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1788521417.129759:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.129803:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.129835:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.129857:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.129864:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.130834:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131131:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131144:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131151:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521417.131198:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131211:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131218:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131224:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131244:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521417.131249:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131321:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131336:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521417.131339:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521417.131345:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131350:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0166eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131366:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131372:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131377:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131394:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521417.131397:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131402:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131420:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521417.131422:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521417.131425:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131431:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0166f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131520:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131526:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131532:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131536:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521417.131539:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131544:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131551:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521417.131553:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521417.131556:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.131561:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0166f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521417.131705:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+30:10296:x1875400346073216:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 2023us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521417.131716:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:0.0:1788521417.134083:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.135591:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346073472 00000100:00100000:1.0:1788521417.135634:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346073472 00000100:00100000:1.0:1788521417.135704:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1788521417.135715:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+30:10296:x1875400346073472:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521417.136035:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+31:10296:x1875400346073472:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 320us (1969us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788521417.136044:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1788521417.189168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.189292:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346073728 00000100:00100000:1.0:1788521417.189305:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346073728 00000100:00100000:1.0:1788521417.189425:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1788521417.189436:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+31:10299:x1875400346073728:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521417.189466:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521417.189492:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403b6 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189602:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189629:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189642:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189661:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189668:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189675:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189871:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189880:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.189887:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521417.189898:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788521417.190009:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190017:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190025:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190031:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521417.190036:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190045:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190060:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521417.190063:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521417.190069:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190088:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190105:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190112:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190118:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190123:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521417.190126:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190132:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190141:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521417.190143:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521417.190146:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190152:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01670e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190202:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 34 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190219:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 33 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.190233:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521417.190235:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521417.190238:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b800, rc 0) 00000100:00100000:1.0:1788521417.190320:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+33:10299:x1875400346073728:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 886us (1165us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788521417.190328:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1788521417.196162:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.196269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346073856 00000100:00100000:1.0:1788521417.196283:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346073856 00000100:00100000:1.0:1788521417.196362:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:1.0:1788521417.196377:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+33:10299:x1875400346073856:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1788521417.196470:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196497:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196513:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196551:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196559:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196567:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196573:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521417.196592:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196601:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196624:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521417.196628:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521417.196632:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.196641:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521417.196753:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+33:10299:x1875400346073856:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 380us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521417.197063:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1788521417.198640:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521417.198747:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346074112 00000100:00100000:2.0:1788521417.198770:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346074112 00000100:00100000:2.0:1788521417.198880:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1788521417.198892:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+33:10299:x1875400346074112:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521417.199195:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+34:10299:x1875400346074112:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 305us (567us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788521417.199204:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1788521417.488017:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521417.488355:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346074368 00000100:00100000:3.0:1788521417.488368:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346074368 00000100:00100000:3.0:1788521417.488448:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:3.0:1788521417.488460:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+34:10329:x1875400346074368:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:3.0:1788521417.488500:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521417.488538:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01672a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403bd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.488686:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.488706:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.488721:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521417.488733:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788521417.488954:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01672a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403bd expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.488977:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403bd expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.488986:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521417.489004:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521417.489009:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521417.489101:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+36:10329:x1875400346074368:12345-192.168.203.48@tcp:101:cat.0 Request processed in 643us (1099us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788521417.489109:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:1.0:1788521417.498353:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521417.498475:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346074624 00000100:00100000:2.0:1788521417.498511:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346074624 00000100:00100000:2.0:1788521417.498591:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1788521417.498603:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+36:10329:x1875400346074624:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:2.0:1788521417.498977:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+37:10329:x1875400346074624:12345-192.168.203.48@tcp:35:cat.0 Request processed in 376us (637us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788521417.498988:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1788521417.506963:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.507091:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346074752 00000100:00100000:1.0:1788521417.507114:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346074752 00000100:00100000:1.0:1788521417.507239:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:1.0:1788521417.507253:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+37:2348:x1875400346074752:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521417.507283:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521417.507320:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403bd expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.507344:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521417.507351:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521417.507425:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46426c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+36:2348:x1875400346074752:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 176us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521417.507449:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1788521417.588295:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.588483:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346075008 00000100:00100000:1.0:1788521417.588493:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346075008 00000100:00100000:1.0:1788521417.588550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1788521417.588574:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+36:10336:x1875400346075008:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:1.0:1788521417.588599:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521417.588603:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788521417.588642:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440393 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.588665:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521417.588671:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521417.588685:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01673f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403c4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.590121:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.590668:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 36 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.590678:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.591262:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 36 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.591286:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 36 pid: 6713 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521417.591321:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368126848:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521417.591438:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a58745540 going to sleep for 11 seconds 00000100:00100000:0.0:1788521417.600168:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.600389:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368126848:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521417.600419:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521417.600770:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346075136 00000100:00100000:3.0:1788521417.600808:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346075136 00010000:00010000:3.0:1788521417.600847:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 37 pid: 6713 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521417.600892:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:3.0:1788521417.600903:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+37:2345:x1875400346075136:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521417.600918:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521417.600925:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 37 pid: 6713 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.600937:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 37 pid: 6713 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.600960:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403b6 expref: 37 pid: 6713 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.600977:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521417.600982:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.600991:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.601016:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.601043:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521417.601271:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+36:2345:x1875400346075136:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 368us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521417.601279:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00010000:00010000:1.0:1788521417.601494:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.601503:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521417.601521:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788521417.601695:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01673f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.601712:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.601720:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521417.601723:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521417.601726:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a800, rc 0) 00000100:00100000:1.0:1788521417.601815:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+36:10336:x1875400346075008:12345-192.168.203.48@tcp:101:dd.0 Request processed in 13202us (13488us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788521417.601823:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:0.0:1788521417.610590:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.610712:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346075392 00000100:00100000:1.0:1788521417.610729:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346075392 00000100:00100000:1.0:1788521417.610831:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1788521417.610842:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+36:10336:x1875400346075392:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:1.0:1788521417.611359:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.611377:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.611388:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521417.611440:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788521417.611466:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005cb0fc53 reply state 00000000342e447b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521417.611474:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521417.611986:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+39:10336:x1875400346075392:12345-192.168.203.48@tcp:36:dd.0 Request processed in 1143us (1402us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788521417.611995:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000020:00080000:1.0:1788521417.612000:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788521417.618865:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.618893:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.618908:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.618913:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521417.618918:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.618926:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.618953:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521417.618956:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521417.618962:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.618968:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016754 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521417.705826:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521417.889082:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521417.889314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346075520 00000100:00100000:3.0:1788521417.889329:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346075520 00000100:00100000:3.0:1788521417.889421:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1788521417.889433:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+38:10350:x1875400346075520:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:3.0:1788521417.889468:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521417.889499:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01675b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.889633:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.889657:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.889677:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.889699:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.889707:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.889749:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.890300:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.890316:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.890326:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.890379:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.890399:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 39 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521417.890417:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7acc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368126976:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521417.890563:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521417.894327:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7acc8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368126976:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521417.894371:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521417.898938:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521417.900894:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346075776 00000100:00100000:3.0:1788521417.900914:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346075776 00000100:00100000:3.0:1788521417.901079:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1788521417.901092:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+40:5586:x1875400346075776:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788521417.901642:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+41:5586:x1875400346075776:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 551us (2718us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788521417.901651:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1788521417.906731:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.906877:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346075904 00000100:00100000:1.0:1788521417.906892:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346075904 00010000:00010000:1.0:1788521417.906946:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 41 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521417.907002:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:1.0:1788521417.907013:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+41:2345:x1875400346075904:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521417.907033:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521417.907043:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 41 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.907072:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 41 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.907099:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016746 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403c4 expref: 41 pid: 5833 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.907118:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521417.907124:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.907136:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.907145:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.907184:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521417.907265:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+40:2345:x1875400346075904:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 254us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521417.907273:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00010000:00010000:0.0:1788521417.907398:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907409:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521417.907470:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788521417.907488:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521417.907541:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907555:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907567:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907574:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907581:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907587:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521417.907592:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907601:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907633:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521417.907636:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521417.907641:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907648:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907660:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907667:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907673:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907679:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521417.907682:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907689:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907696:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4000) 00010000:00010000:0.0:1788521417.907698:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521417.907701:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907707:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.907766:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01675b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403cb expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.908143:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403cb expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521417.908152:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:0.0:1788521417.908155:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521417.908158:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0c00, rc 0) 00000100:00100000:0.0:1788521417.908214:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+39:10350:x1875400346075520:12345-192.168.203.48@tcp:101:stat.0 Request processed in 18783us (19154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521417.908224:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1788521417.984376:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521417.984712:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346076160 00000100:00100000:1.0:1788521417.984737:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346076160 00000100:00100000:1.0:1788521417.984851:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:1.0:1788521417.984864:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+39:10356:x1875400346076160:12345-192.168.203.48@tcp:36:truncate.0 00010000:00010000:1.0:1788521417.984954:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521417.984998:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403cb expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.985042:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521417.985049:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521417.985358:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.985379:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521417.985389:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521417.985447:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788521417.985475:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5b41002 reply state 000000006a6007a7 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521417.985484:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521417.986052:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+41:10356:x1875400346076160:12345-192.168.203.48@tcp:36:truncate.0 Request processed in 1187us (1688us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788521417.986063:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000020:00080000:1.0:1788521417.986069:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521417.988304:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.988330:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.988339:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.988346:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521417.988352:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.988361:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.988384:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521417.988388:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521417.988394:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521417.988401:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016777 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521418.137898:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.138050:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346076288 00000100:00100000:1.0:1788521418.138063:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346076288 00000100:00100000:1.0:1788521418.138162:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:1.0:1788521418.138176:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+40:10370:x1875400346076288:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:1.0:1788521418.138206:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521418.138233:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01677e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403d2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138343:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138361:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138374:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138390:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138398:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138404:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138512:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138522:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138529:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521418.138572:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788521418.138577:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521418.138619:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138643:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138652:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138660:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138667:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138674:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521418.138679:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138688:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138702:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521418.138706:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521418.138711:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138718:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016785 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138733:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138740:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138753:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138824:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521418.138829:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138836:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138844:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521418.138847:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521418.138850:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138856:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01678c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138895:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01677e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138911:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.138919:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521418.138922:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521418.138924:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521418.139001:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+41:10370:x1875400346076288:12345-192.168.203.48@tcp:101:stat.0 Request processed in 830us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521418.139019:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00080000:2.0:1788521418.139458:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521418.239155:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.239310:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346076544 00000100:00100000:3.0:1788521418.239322:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346076544 00000100:00100000:3.0:1788521418.239458:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1788521418.239472:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+41:10380:x1875400346076544:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521418.239515:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521418.239545:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01679a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403d9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521418.239714:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788521418.240405:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01679a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d9 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.240428:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:3.0:1788521418.240431:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521418.240438:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae01679a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d9 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.240456:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0c00, rc 0) 00000100:00100000:3.0:1788521418.240554:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+42:10380:x1875400346076544:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1084us (1425us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788521418.240564:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:0.0:1788521418.247529:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.248049:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346076800 00000100:00100000:1.0:1788521418.248064:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346076800 00000100:00100000:1.0:1788521418.248142:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1788521418.248154:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+42:10380:x1875400346076800:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521418.248625:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+43:10380:x1875400346076800:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 471us (1110us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788521418.248634:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521418.335069:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.335199:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346077056 00000100:00100000:1.0:1788521418.335214:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346077056 00000100:00100000:1.0:1788521418.335299:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:1.0:1788521418.335314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+43:10386:x1875400346077056:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521418.335345:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521418.335375:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0167a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403e0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.335515:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.335533:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.335543:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.335589:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.335639:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 44 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521418.335668:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368127104:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521418.335868:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a58745d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521418.340497:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.340742:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346077184 00000100:00100000:3.0:1788521418.340755:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346077184 00010000:00010000:3.0:1788521418.340842:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521418.340884:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1788521418.340896:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+45:2346:x1875400346077184:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521418.340915:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521418.340922:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.340957:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 45 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.340990:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521418.340996:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.341009:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.341018:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.341048:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521418.341126:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+45:2346:x1875400346077184:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 231us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521418.341204:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00010000:00010000:1.0:1788521418.341517:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403d2 expref: 44 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521418.341539:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368127104:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521418.341567:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.341578:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.341584:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521418.341621:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788521418.342111:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0167a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.342130:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.342913:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521418.342929:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521418.342934:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b000, rc 0) 00000100:00100000:1.0:1788521418.343057:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+44:10386:x1875400346077056:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7746us (8001us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788521418.343067:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1788521418.354461:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521418.354548:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346077440 00000100:00100000:0.0:1788521418.354563:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346077440 00000100:00100000:0.0:1788521418.354645:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1788521418.354668:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+44:10386:x1875400346077440:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1788521418.355485:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.355512:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.355537:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521418.356097:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788521418.358305:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cff36f7e reply state 000000003c54d99c transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521418.358335:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521418.363095:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+47:10386:x1875400346077440:12345-192.168.203.48@tcp:36:bash.0 Request processed in 8415us (8948us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788521418.363113:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000020:00080000:3.0:1788521418.363123:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788521418.374222:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.374250:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.374260:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.374267:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521418.374273:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.374283:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.374309:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:0.0:1788521418.374312:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521418.374320:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.374327:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0167bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521418.375506:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521418.375610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346077568 00000100:00100000:2.0:1788521418.375625:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346077568 00000100:00100000:2.0:1788521418.375710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1788521418.375728:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+46:10386:x1875400346077568:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1788521418.375768:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521418.375823:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae0167c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403e7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.375951:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.375968:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.375979:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.376030:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.376049:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 47 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521418.376066:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a60529f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368127232:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521418.376197:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788521418.382334:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521418.382624:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a60529f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368127232:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521418.382668:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521418.382825:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346077696 00000100:00100000:1.0:1788521418.382835:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346077696 00010000:00010000:1.0:1788521418.382880:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 48 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521418.382927:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1788521418.382939:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+48:2346:x1875400346077696:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521418.382959:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521418.382966:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 48 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.382982:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 48 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.383009:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e0 expref: 48 pid: 5833 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.383027:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521418.383031:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.383043:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.383070:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.383103:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521418.383132:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.383140:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521418.383191:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+47:2346:x1875400346077696:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 253us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521418.383199:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000004:00200000:0.0:1788521418.383206:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788521418.383211:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521418.383238:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.383276:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae0167c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e7 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.383293:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e7 expref: 46 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521418.383302:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:0.0:1788521418.383305:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521418.383308:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea400, rc 0) 00000100:00100000:0.0:1788521418.383337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+46:10386:x1875400346077568:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7617us (7844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521418.383344:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1788521418.390194:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521418.390312:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346077952 00000100:00100000:0.0:1788521418.390326:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346077952 00000100:00100000:0.0:1788521418.390400:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1788521418.390411:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+46:10386:x1875400346077952:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1788521418.390738:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a88c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+47:10386:x1875400346077952:12345-192.168.203.48@tcp:35:bash.0 Request processed in 328us (558us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788521418.390746:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000001:00080000:0.0:1788521418.414148:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:0.0:1788521418.414237:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788521418.414263:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a48ac8180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788521418.414269:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a43a4a700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a48ac83c0 00000020:00080000:0.0:1788521418.414273:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a43a4a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a75921800 00000020:00080000:3.0:1788521418.414519:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788521418.414659:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788521418.414671:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521418.414696:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a60529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368127360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788521418.414824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521418.414930:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368127360 00000100:00100000:2.0:1788521418.414941:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368127360 00000100:00100000:2.0:1788521418.415017:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521418.415028:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368127360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788521418.415062:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788521418.415108:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9aabc8, atime: 0x6a9aabc8, ctime: 0x6a9aabc8, blocks: 0xb 00010000:00010000:2.0:1788521418.415117:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.415137:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1788521418.415143:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521418.415151:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.415170:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.415181:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.415189:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.415206:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521418.415811:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368127360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 748us (951us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788521418.415821:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788521418.415996:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521418.416012:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521418.416028:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.416039:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521418.416044:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.416056:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.416077:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.416086:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9e587d9/0x53df1cebae0167d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.416111:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521418.416113:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521418.416115:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788521418.416165:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a60529f80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788521418.416172:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a60529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368127360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788521418.464432:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.464525:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346078208 00000100:00100000:3.0:1788521418.464540:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346078208 00000100:00100000:3.0:1788521418.464628:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1788521418.464639:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+14:10396:x1875400346078208:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521418.464664:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521418.464687:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0167d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403ee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521418.464965:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788521418.465076:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0167d9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403ee expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.465091:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:3.0:1788521418.465095:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521418.465101:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0167d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403ee expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.465116:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0c00, rc 0) 00000100:00100000:3.0:1788521418.465185:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+15:10396:x1875400346078208:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 547us (767us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788521418.465192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:0.0:1788521418.469519:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.469647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346078336 00000100:00100000:1.0:1788521418.469657:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346078336 00000100:00100000:1.0:1788521418.469724:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:1.0:1788521418.469737:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+15:10396:x1875400346078336:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1788521418.469875:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.469895:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.469906:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470011:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470035:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470050:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470457:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470469:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470478:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521418.470542:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470559:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470566:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.470573:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471800:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521418.471818:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471849:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471871:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521418.471875:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521418.471881:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471888:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0167e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471908:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471915:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471921:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471926:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521418.471929:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471934:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471941:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a46737600) 00010000:00010000:2.0:1788521418.471944:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521418.471947:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471963:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae0167ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471984:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471990:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.471995:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.472001:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521418.472004:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.472010:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.472019:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521418.472021:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521418.472025:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.472031:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae0167f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521418.472223:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+15:10396:x1875400346078336:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 2479us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521418.472237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:2.0:1788521418.479317:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.483208:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346078592 00000100:00100000:1.0:1788521418.483231:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346078592 00000100:00100000:1.0:1788521418.483301:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1788521418.483311:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+15:10396:x1875400346078592:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521418.484659:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+16:10396:x1875400346078592:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 1343us (5352us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788521418.484668:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1788521418.527837:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.527930:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346078848 00000100:00100000:1.0:1788521418.527945:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346078848 00000100:00100000:1.0:1788521418.528030:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1788521418.528044:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+16:10399:x1875400346078848:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521418.528066:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521418.528088:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0167fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403f5 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528185:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528199:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528211:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528226:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528233:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528239:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528608:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016811 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528619:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.528639:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016811 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521418.528879:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788521418.529002:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529010:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529017:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529022:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521418.529026:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529034:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529048:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521418.529051:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521418.529056:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529061:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016803 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529075:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529081:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529096:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529102:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521418.529105:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529172:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529181:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521418.529184:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521418.529187:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529192:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01680a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529243:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0167fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403f5 expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529319:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016811 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403f5 expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521418.529327:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521418.529329:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521418.529331:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a400, rc 0) 00000100:00100000:1.0:1788521418.529616:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+18:10399:x1875400346078848:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1572us (1839us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788521418.529634:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:0.0:1788521418.537280:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521418.537342:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521418.537445:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346078976 00000100:00100000:2.0:1788521418.537459:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346078976 00000100:00100000:2.0:1788521418.537545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1788521418.537557:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:10399:x1875400346078976:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521418.537964:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.537990:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538007:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538047:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538055:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538062:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538069:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521418.538075:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538083:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538097:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521418.538101:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521418.538122:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.538129:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01681f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521418.538223:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:10399:x1875400346078976:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 667us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521418.538232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1788521418.538925:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346079104 00000100:00100000:3.0:1788521418.538934:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346079104 00000100:00100000:3.0:1788521418.538996:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1788521418.539006:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:2346:x1875400346079104:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521418.539024:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521418.539048:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016811 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403f5 expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.539067:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521418.539071:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521418.539129:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+17:2346:x1875400346079104:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 124us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521418.539152:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1788521418.542136:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521418.542245:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346079360 00000100:00100000:2.0:1788521418.542260:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346079360 00000100:00100000:2.0:1788521418.542345:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1788521418.542358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+17:10399:x1875400346079360:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521418.542990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+18:10399:x1875400346079360:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 631us (866us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788521418.543000:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1788521418.692314:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.692442:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346079616 00000100:00100000:3.0:1788521418.692456:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346079616 00000100:00100000:3.0:1788521418.692537:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:3.0:1788521418.692550:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+18:10417:x1875400346079616:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:3.0:1788521418.692582:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521418.692623:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016826 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64403fc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.692825:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01682d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.692846:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01682d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.692863:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01682d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521418.692878:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788521418.693060:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016826 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403fc expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.693083:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01682d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403fc expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.693093:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521418.693096:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788521418.693100:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521418.693201:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:10417:x1875400346079616:12345-192.168.203.48@tcp:101:cat.0 Request processed in 654us (903us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788521418.693209:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:0.0:1788521418.727423:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521418.727553:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346079744 00000100:00100000:2.0:1788521418.727566:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346079744 00000100:00100000:2.0:1788521418.727664:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:2.0:1788521418.727678:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:10418:x1875400346079744:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521418.727713:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521418.727764:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01683b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440403 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.727924:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.727944:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.727980:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521418.728030:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788521418.728034:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521418.728056:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.728089:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae01683b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440403 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.728111:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440403 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.728122:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521418.728124:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521418.728130:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea200, rc 0) 00000100:00100000:2.0:1788521418.728222:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+21:10418:x1875400346079744:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 547us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521418.728232:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:2.0:1788521418.729558:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521418.732284:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.732456:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080128 00000100:00100000:1.0:1788521418.732469:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080128 00000100:00100000:1.0:1788521418.732546:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1788521418.732558:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:10418:x1875400346080128:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521418.733515:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:10418:x1875400346080128:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 951us (1238us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788521418.733526:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1788521418.739183:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.739290:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080256 00000100:00100000:3.0:1788521418.739306:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080256 00000100:00100000:3.0:1788521418.739386:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1788521418.739400:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+22:10418:x1875400346080256:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:3.0:1788521418.739420:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788521418.739453:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae0167cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403e7 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.739493:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae01682d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403fc expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.739510:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0166d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64403a8 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.739521:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:3.0:1788521418.739535:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521418.739616:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+19:10418:x1875400346080256:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 219us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521418.739625:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1788521418.743915:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.744050:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080384 00000100:00100000:3.0:1788521418.744065:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080384 00000100:00100000:3.0:1788521418.744158:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:3.0:1788521418.744170:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:10418:x1875400346080384:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:3.0:1788521418.744350:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.744384:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521418.744401:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521418.745262:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521418.745514:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788521418.745609:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788521418.745819:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:10418:x1875400346080384:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 1645us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521418.745833:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:0.0:1788521418.780411:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521418.780767:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080512 00000100:00100000:2.0:1788521418.780819:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080512 00000100:00100000:2.0:1788521418.780910:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1788521418.780922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:10420:x1875400346080512:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521418.780951:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521418.780999:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016850 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644040a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781240:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781259:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781273:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781291:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781298:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781304:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781675:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781685:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.781694:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521418.781995:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788521418.782001:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521418.782030:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782054:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782064:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782071:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782079:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782086:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521418.782091:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782102:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782117:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521418.782121:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521418.782126:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782133:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782147:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782153:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782165:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782170:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beba00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521418.782172:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782178:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782186:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a46737600) 00010000:00010000:2.0:1788521418.782188:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521418.782191:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782197:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae01685e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782239:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016850 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782256:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521418.782263:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:2.0:1788521418.782265:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521418.782268:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00100000:2.0:1788521418.782578:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:10420:x1875400346080512:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1654us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521418.782615:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:1.0:1788521418.869255:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.869359:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521418.869399:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521418.869505:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080896 00000100:00100000:3.0:1788521418.869518:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080896 00000100:00100000:3.0:1788521418.869620:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:3.0:1788521418.869631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346080896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521418.869759:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346080896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 124us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521418.869769:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:3.0:1788521418.869839:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080768 00000100:00100000:3.0:1788521418.869844:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080768 00000100:00100000:3.0:1788521418.869876:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1788521418.869883:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346080768:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521418.869912:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346080768:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521418.869920:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00080000:1.0:1788521418.871071:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521418.871079:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521418.874018:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346080640 00000100:00100000:2.0:1788521418.874038:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346080640 00000100:00100000:2.0:1788521418.874117:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 287 00000100:00100000:2.0:1788521418.874129:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346080640:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521418.874287:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46237c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346080640:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 160us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521418.874297:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 287 00000040:00080000:3.0:1788521418.987136:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521418.987158:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521418.987239:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788521418.987517:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521418.987663:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7acc8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368127488:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521418.988071:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc540 going to sleep for 11 seconds 00000100:00100000:1.0:1788521419.014363:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.014398:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7acc8e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368127488:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521419.014425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346081024 00000100:00100000:1.0:1788521419.014439:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346081024 00000100:00100000:1.0:1788521419.014533:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1788521419.014547:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081024:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788521419.014686:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081024:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 Request processed in 142us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521419.014696:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1788521419.018331:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.018421:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346081152 00000100:00100000:3.0:1788521419.018432:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346081152 00000100:00100000:3.0:1788521419.018495:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1788521419.018506:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081152:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521419.018537:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521419.018670:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081152:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 163us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.018678:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1788521419.031277:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.031408:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346081280 00000100:00100000:0.0:1788521419.031421:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346081280 00000100:00100000:0.0:1788521419.031492:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1788521419.031503:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081280:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521419.031585:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031635:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031650:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031731:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031739:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031746:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031812:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031822:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.031830:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521419.031866:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788521419.031870:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521419.031883:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032121:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032140:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032147:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032153:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521419.032158:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032166:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032178:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:0.0:1788521419.032182:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521419.032187:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032193:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01686c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032209:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032214:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032220:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032225:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521419.032234:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032241:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032249:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8c0a4fa31a00) 00010000:00010000:0.0:1788521419.032252:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521419.032255:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032261:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016873 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032277:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032283:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032289:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032293:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521419.032296:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032301:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032308:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:0.0:1788521419.032310:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521419.032319:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.032325:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01687a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521419.032524:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081280:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1020us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521419.032534:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1788521419.042017:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.051738:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346081536 00000100:00100000:0.0:1788521419.051765:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346081536 00000100:00100000:1.0:1788521419.052004:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:1.0:1788521419.052018:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+20:10431:x1875400346081536:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521419.052047:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521419.052076:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440411 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052211:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052231:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052246:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521419.052260:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788521419.052410:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052419:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052425:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052431:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.052435:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052444:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052829:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:1.0:1788521419.052832:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521419.052839:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052846:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052900:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016881 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440411 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052911:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:1.0:1788521419.052913:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521419.052917:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440411 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.052926:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575ac00, rc 0) 00000100:00100000:1.0:1788521419.053011:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:10431:x1875400346081536:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 995us (11007us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788521419.053020:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:1.0:1788521419.060714:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.060851:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346081664 00000100:00100000:3.0:1788521419.060864:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346081664 00000100:00100000:3.0:1788521419.060939:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:3.0:1788521419.060950:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:10431:x1875400346081664:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521419.060997:0:6713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521419.061132:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:10431:x1875400346081664:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 184us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.061140:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:1.0:1788521419.074686:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.075436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346081920 00000100:00100000:0.0:1788521419.075451:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346081920 00000100:00100000:0.0:1788521419.075540:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:0.0:1788521419.075552:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:10431:x1875400346081920:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521419.075581:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521419.075585:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521419.075630:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440403 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.075650:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521419.075657:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521419.075674:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016896 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440418 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521419.076468:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788521419.076827:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01689d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.076846:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01689d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.076868:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01689d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.076942:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016896 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440418 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.076962:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01689d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440418 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.076972:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31a00) 00010000:00010000:0.0:1788521419.076976:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521419.076979:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5800, rc 0) 00000100:00100000:0.0:1788521419.077068:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:10431:x1875400346081920:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1517us (2392us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788521419.077079:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:1.0:1788521419.092614:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.092857:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346082176 00000100:00100000:0.0:1788521419.092872:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346082176 00000100:00100000:0.0:1788521419.092937:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:0.0:1788521419.092950:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+22:10431:x1875400346082176:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521419.093028:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521419.093065:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae01689d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440418 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.093086:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31a00) 00010000:00010000:0.0:1788521419.093100:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521419.093129:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.093156:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.093169:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.094907:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.094932:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.094944:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.095199:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.095208:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098342:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098352:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521419.098359:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098393:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098417:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521419.098421:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521419.098427:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098435:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098459:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098466:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098473:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098477:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beba00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521419.098480:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098485:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098492:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x899eebf0 (ffff8c0a46737600) 00010000:00010000:2.0:1788521419.098494:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521419.098496:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.098510:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x899eebf0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521419.098687:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:10431:x1875400346082176:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 5731us (6088us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521419.098697:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1788521419.102578:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.103604:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346082304 00000100:00100000:0.0:1788521419.103622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346082304 00000100:00100000:0.0:1788521419.103707:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:0.0:1788521419.103719:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:10431:x1875400346082304:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521419.103738:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521419.103765:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0168b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644041f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.103845:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.103862:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.103878:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.103996:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae0168b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.104020:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.104042:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521419.104046:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788521419.104051:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045a00, rc 0) 00000100:00100000:0.0:1788521419.104623:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:10431:x1875400346082304:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 874us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521419.104633:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:0.0:1788521419.110760:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.110876:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346082560 00000100:00100000:1.0:1788521419.110891:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346082560 00000100:00100000:1.0:1788521419.110962:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:1.0:1788521419.110975:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+22:10431:x1875400346082560:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521419.111092:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.111113:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.111126:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521419.111466:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1788521419.111476:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340189701808ns, next at 341189699603ns, rc = 0 00000004:00010000:1.0:1788521419.111588:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce11ac21 reply state 0000000082ed1c5d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.111606:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521419.111727:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:10431:x1875400346082560:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 752us (974us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788521419.111736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:1.0:1788521419.115367:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.115569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346082688 00000100:00100000:2.0:1788521419.115586:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346082688 00000100:00100000:2.0:1788521419.115684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1788521419.115700:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:10431:x1875400346082688:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521419.115736:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521419.115764:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440426 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.115882:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.115899:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.115930:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:2.0:1788521419.115934:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521419.115938:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beba00, rc 0) 00000100:00100000:2.0:1788521419.116017:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+25:10431:x1875400346082688:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 323us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521419.116025:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00010000:00010000:3.0:1788521419.120934:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.120976:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.120983:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.120989:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521419.120994:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.121002:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.121022:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:3.0:1788521419.121025:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521419.121031:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.121038:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae0168c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.126688:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.127125:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346082816 00000100:00100000:2.0:1788521419.127143:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346082816 00000100:00100000:2.0:1788521419.127214:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1788521419.127224:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875400346082816:12345-192.168.203.48@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788521419.127266:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:2.0:1788521419.127311:0:6692:0:(genops.c:1385:class_connect()) connect: client 0ec78abe-db90-4086-b379-6c867e47751e, cookie 0x53df1cebae0168d5 00002000:00100000:2.0:1788521419.127325:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0ec78abe-db90-4086-b379-6c867e47751e/ffff8c0941156800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521419.127366:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521419.127704:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521419.127746:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8c0941150000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521419.127880:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2344:x1875400346082816:12345-192.168.203.48@tcp:8:lhsmtool_posix.0 Request processed in 655us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521419.127888:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1788521419.131441:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.132181:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346082944 00000100:00100000:1.0:1788521419.132191:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346082944 00000100:00100000:1.0:1788521419.132277:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:1.0:1788521419.132286:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:0:x1875400346082944:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788521419.132587:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521419.192968:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:0:x1875400346082944:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 60665us (61522us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788521419.192986:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000001:00080000:3.0:1788521419.193206:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788521419.193221:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000100:00100000:3.0:1788521419.200327:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.200429:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346083200 00000100:00100000:0.0:1788521419.200444:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346083200 00000100:00100000:0.0:1788521419.200514:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:0.0:1788521419.200525:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:10431:x1875400346083200:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788521419.200914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+25:10431:x1875400346083200:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 389us (608us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788521419.200924:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1788521419.203947:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.204063:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346083456 00000100:00100000:0.0:1788521419.204077:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346083456 00000100:00100000:0.0:1788521419.204177:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:0.0:1788521419.204188:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+25:10431:x1875400346083456:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521419.204327:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+25:10431:x1875400346083456:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 140us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521419.204336:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:0.0:1788521419.207125:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.207234:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346083584 00000100:00100000:3.0:1788521419.207249:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346083584 00000100:00100000:3.0:1788521419.207318:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1788521419.207330:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+25:10431:x1875400346083584:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521419.207361:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521419.207387:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0168dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644042d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.207482:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0168e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.207501:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0168e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.207516:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0168e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521419.207557:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521419.207766:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0168e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.207841:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0168dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644042d expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.207863:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0168e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644042d expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.207873:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:3.0:1788521419.207876:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521419.207881:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1000, rc 0) 00000100:00100000:3.0:1788521419.207949:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+26:10431:x1875400346083584:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 622us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.207957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:0.0:1788521419.211618:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.211809:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346083712 00000100:00100000:1.0:1788521419.211823:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346083712 00000100:00100000:1.0:1788521419.211911:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:1.0:1788521419.212865:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+5:2346:x1875400346083712:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521419.212898:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521419.212936:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440434 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521419.212976:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aabca, blocks: 0x1 00010000:00010000:1.0:1788521419.213005:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788521419.213010:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521419.213025:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.213052:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.213073:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a400, rc 0) 00000100:00100000:1.0:1788521419.213359:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346083712:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1428us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521419.213367:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1788521419.220619:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.220751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346083968 00000100:00100000:1.0:1788521419.220763:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346083968 00000100:00100000:1.0:1788521419.220873:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1788521419.220886:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+26:10431:x1875400346083968:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521419.221053:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+26:10431:x1875400346083968:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 168us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521419.221062:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:3.0:1788521419.223268:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.223366:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084096 00000100:00100000:2.0:1788521419.223380:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084096 00000100:00100000:2.0:1788521419.223488:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:2.0:1788521419.223505:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:10431:x1875400346084096:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521419.223529:0:8219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521419.223555:0:8219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644043b expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.223612:0:8219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.223623:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521419.223628:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521419.223649:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 7 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.223697:0:8219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.223722:0:8219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521419.223739:0:8219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368127616:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521419.224005:0:8219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c1300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521419.225952:0:8219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d17480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368127616:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521419.225994:0:8219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 7 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.226020:0:8219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea200, rc 0) 00000100:00100000:2.0:1788521419.226113:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:10431:x1875400346084096:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2613us (2857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521419.226123:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1788521419.227100:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.228180:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084224 00000100:00100000:1.0:1788521419.228196:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084224 00010000:00010000:1.0:1788521419.228252:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.228312:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:1.0:1788521419.228326:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346084224:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521419.228345:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521419.228375:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.228392:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.228423:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018c82006/0x53df1cebae0168ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440434 expref: 7 pid: 6692 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.228440:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521419.228445:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521419.228457:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 6 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.228468:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 6 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.228517:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 6 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.228546:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875400368127744:192.168.203.48@tcp:105: 00000100:00100000:1.0:1788521419.228656:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a5365a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788521419.235043:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.235085:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084352 00000100:00100000:0.0:1788521419.235095:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084352 00002000:00100000:0.0:1788521419.235161:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c0a7f7b5c00 x1875400346084352/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:420/0 lens 504/0 e 0 to 0 dl 1788521430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521419.235174:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7f7b5c00 with x1875400346084352 ext(0->8) 00002000:00010000:0.0:1788521419.235180:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7f7b5c00 00000100:00100000:0.0:1788521419.235224:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1788521419.235236:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346084352:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788521419.236716:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1875400368127744:192.168.203.48@tcp:105: 00010000:00010000:3.0:1788521419.236754:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521419.236853:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46426450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346084224:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 8530us (9758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.236865:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1788521419.238612:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346084352:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 3236us (3440us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788521419.238633:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00002000:00100000:0.0:1788521419.238650:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8c0a7f7b5c00 x1875400346084352/t4294967302(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:420/0 lens 504/448 e 0 to 0 dl 1788521430 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521419.238662:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7f7b5c00 with x1875400346084352 ext(0->8) 00002000:00010000:0.0:1788521419.238671:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7f7b5c00 00000100:00100000:0.0:1788521419.241497:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.248460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084480 00000100:00100000:2.0:1788521419.248475:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084480 00000100:00100000:2.0:1788521419.248556:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:2.0:1788521419.248568:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+26:10431:x1875400346084480:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788521419.319932:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+26:10431:x1875400346084480:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 71354us (78436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521419.319962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000001:00080000:1.0:1788521419.320097:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1788521419.320138:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788521419.320194:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:1.0:1788521419.320481:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521419.320502:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368127872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788521419.320577:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788521419.322392:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788521419.322412:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788521419.322432:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368127872 00000100:00100000:3.0:1788521419.322443:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368127872 00000100:00100000:3.0:1788521419.322524:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521419.322534:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368127872:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788521419.323129:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788521419.326074:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788521419.326087:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788521419 00002000:00010000:3.0:1788521419.326090:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788521419.326092:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788521418 -> 1788521419 00002000:00010000:3.0:1788521419.326096:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788521419.326231:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368127872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3690us (5646us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788521419.326247:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521419.326366:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.326406:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084608 00000100:00100000:3.0:1788521419.326417:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084608 00000100:00100000:3.0:1788521419.326471:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:3.0:1788521419.326482:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346084608:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788521419.330142:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a7f258a80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788521419.330161:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368127872:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788521419.400079:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346084608:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 73581us (73700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.400097:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000001:00080000:3.0:1788521419.400223:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1788521419.400243:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1788521419.408202:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.408350:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084864 00000100:00100000:1.0:1788521419.408363:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084864 00000100:00100000:1.0:1788521419.408435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:1.0:1788521419.408448:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+13:10431:x1875400346084864:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521419.408526:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521419.408567:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0168e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644042d expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.408603:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521419.408609:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521419.408656:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.408675:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.408689:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521419.409135:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063c9901f reply state 000000007f98b1c5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.409148:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521419.409297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+14:10431:x1875400346084864:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 849us (1108us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788521419.409306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:0.0:1788521419.413365:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1788521419.413497:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.413515:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.413524:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.413532:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.413538:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.413547:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.413572:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521419.413576:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521419.413581:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.413589:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0168f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.413670:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346084992 00000100:00100000:3.0:1788521419.413683:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346084992 00000100:00100000:3.0:1788521419.413747:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1788521419.413759:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346084992:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788521419.414240:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788521419.414245:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788521419 -> 1788521418 00002000:00010000:3.0:1788521419.414248:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788521416 00002000:00010000:3.0:1788521419.414255:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788521419 -> 1788521418 00002000:00010000:3.0:1788521419.414257:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788521419.414372:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346084992:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 613us (1017us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788521419.414382:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1788521419.418193:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.418362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346085248 00000100:00100000:0.0:1788521419.418375:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346085248 00000100:00100000:0.0:1788521419.418450:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:0.0:1788521419.418463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+13:10431:x1875400346085248:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788521419.418565:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.418585:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.418605:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.418663:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.418681:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 13 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521419.418699:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368128000:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521419.418847:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788521419.424321:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.424421:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346085376 00000100:00100000:2.0:1788521419.424433:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346085376 00010000:00010000:2.0:1788521419.424491:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.424491:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368128000:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521419.424528:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521419.424541:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:2.0:1788521419.424552:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+14:2346:x1875400346085376:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521419.424570:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521419.424579:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.424615:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.424644:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae0168c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644041f expref: 14 pid: 5834 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.424664:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:2.0:1788521419.424670:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.424683:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.424693:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.424747:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521419.424812:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424820:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424862:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424870:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424876:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424883:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.424889:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424898:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424909:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521419.424912:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788521419.424917:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.424935:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae0168ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521419.425012:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:2346:x1875400346085376:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 460us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521419.425021:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1788521419.426462:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+12:10431:x1875400346085248:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 7989us (8273us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788521419.426480:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:3.0:1788521419.429851:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.430034:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346085504 00000100:00100000:3.0:1788521419.430048:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346085504 00000100:00100000:3.0:1788521419.430216:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1788521419.430229:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346085504:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788521419.430287:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.430323:0:8219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 7 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.430333:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521419.430338:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521419.430344:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.430392:0:8219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 7 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.430409:0:8219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 7 pid: 8219 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.430426:0:8219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7acc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368128128:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521419.430520:0:8219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a454eb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521419.434124:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.434849:0:8219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7acc8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368128128:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521419.434895:0:8219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.435033:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346085632 00000100:00100000:1.0:1788521419.435041:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346085632 00010000:00010000:1.0:1788521419.435089:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 8 pid: 8219 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.435222:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1788521419.435233:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346085632:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521419.435252:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521419.435284:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 8 pid: 8219 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.435299:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 8 pid: 8219 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.435329:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e587d9/0x53df1cebae0168f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644043b expref: 8 pid: 8219 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.435347:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521419.435352:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521419.435359:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.435386:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.435422:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521419.435488:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346085632:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 257us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521419.435497:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00010000:00010000:3.0:1788521419.435653:0:8219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435665:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435699:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435904:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435913:0:8219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435920:0:8219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521419.435926:0:8219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435936:0:8219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435954:0:8219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.435962:0:8219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f57e8de2/0x53df1cebae016906 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.436018:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346085504:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 5792us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.436027:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1788521419.439658:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.439766:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346085888 00000100:00100000:1.0:1788521419.439808:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346085888 00000100:00100000:1.0:1788521419.439881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:1.0:1788521419.439893:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+12:10431:x1875400346085888:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788521419.439997:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440018:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440032:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440326:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440339:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440349:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440398:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.440414:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 13 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.440432:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368128256:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521419.440532:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a466429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521419.443729:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.443813:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346086016 00000100:00100000:3.0:1788521419.443837:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346086016 00010000:00010000:3.0:1788521419.443903:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.443957:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1788521419.443970:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:2345:x1875400346086016:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521419.443993:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521419.444003:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.444019:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 14 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.444052:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:3.0:1788521419.444058:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.444070:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.444079:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.444107:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521419.444461:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:2345:x1875400346086016:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 493us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.444469:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00010000:00010000:1.0:1788521419.444686:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae0168ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440426 expref: 13 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.444706:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368128256:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521419.444733:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.444756:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.444763:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521419.445063:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788521419.446493:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788521419.446563:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788521419.446702:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368128384:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788521419.446826:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521419.446868:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4153c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521419.446964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368128384 00000100:00100000:3.0:1788521419.446974:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368128384 00000100:00100000:3.0:1788521419.447042:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521419.447052:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875400368128384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788521419.447344:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875400368128384:12345-0@lo:1000:mdt00_000.0 Request processed in 292us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.447353:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521419.447608:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788521419.447616:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a7f258a80, transno 4294967303 00000100:00100000:0.0:1788521419.447639:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368128384:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788521419.449419:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788521419.449526:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368128512:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788521419.449619:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521419.449655:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521419.449974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368128512 00000100:00100000:2.0:1788521419.449984:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368128512 00000100:00100000:2.0:1788521419.450051:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521419.450063:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1875400368128512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788521419.452060:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368128512:12345-0@lo:1000:mdt00_000.0 Request processed in 1985us (2426us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788521419.452078:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521419.452394:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368128512:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788521419.452459:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452471:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452479:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452487:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.452492:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452502:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452525:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31f00) 00010000:00010000:1.0:1788521419.452528:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521419.452535:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452542:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016914 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452591:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452609:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452614:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452633:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.452636:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452643:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452653:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:1.0:1788521419.452655:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521419.452659:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.452665:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016849 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.453024:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.453045:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.453056:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.453104:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.453228:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 16 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.453262:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368128640:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521419.453414:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a411ca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521419.457430:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521419.457475:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346086144 00000100:00100000:2.0:1788521419.457487:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346086144 00010000:00010000:2.0:1788521419.457542:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521419.457634:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:2.0:1788521419.457647:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+17:2346:x1875400346086144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521419.457669:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521419.457677:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.457696:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 17 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.457744:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:2.0:1788521419.457749:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.457763:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.457796:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521419.457821:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521419.457887:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+17:2346:x1875400346086144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 242us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521419.457895:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00010000:00010000:1.0:1788521419.459834:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644040a expref: 16 pid: 5833 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.459866:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368128640:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521419.459908:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459922:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459928:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459945:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459959:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459965:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.459971:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.459979:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460017:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:1.0:1788521419.460020:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521419.460026:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460033:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01691b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460045:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460052:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460480:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460487:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.460490:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460498:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460509:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a65ff4300) 00010000:00010000:1.0:1788521419.460512:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521419.460515:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.460521:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae01690d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521419.463197:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521419.463210:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788521419.463217:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+15:10431:x1875400346085888:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 23317us (23563us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788521419.463233:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000020:00080000:1.0:1788521419.463241:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788521419.463248:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788521419.463255:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521419.467656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.467885:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346086400 00000100:00100000:0.0:1788521419.467898:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346086400 00000100:00100000:0.0:1788521419.468056:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1788521419.468069:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+15:10431:x1875400346086400:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521419.469476:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521419.469685:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788521419.469990:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.470014:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.470028:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.470040:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.470046:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.470054:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.470116:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521419.470262:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+17:10431:x1875400346086400:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 2190us (2684us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788521419.470273:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000020:00080000:0.0:1788521419.470280:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521419.471368:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521419.471380:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.471391:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521419.471396:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.471407:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.471426:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8c0a4fa31300) 00010000:00010000:3.0:1788521419.471429:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788521419.471435:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.471441:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016922 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.471609:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521419.471611:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521419.471614:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521419.687951:0:12012:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521419.687967:0:12012:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521419.688019:0:12012:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788521419.688027:0:12012:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788521419.754028:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521419.809674:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.809948:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346086656 00000100:00100000:1.0:1788521419.809962:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346086656 00000100:00100000:1.0:1788521419.810053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1788521419.810068:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+17:10442:x1875400346086656:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521419.810102:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521419.810131:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016929 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440442 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.810256:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016930 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.810275:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.810289:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016930 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521419.810302:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788521419.810461:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016929 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440442 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.810696:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016930 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440442 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.810727:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521419.810731:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521419.810736:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b800, rc 0) 00000100:00100000:1.0:1788521419.810867:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:10442:x1875400346086656:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 801us (1208us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788521419.810876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1788521419.817426:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.817501:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346086784 00000100:00100000:0.0:1788521419.817515:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346086784 00000100:00100000:0.0:1788521419.817599:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:0.0:1788521419.817616:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+19:10442:x1875400346086784:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1788521419.817735:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.817759:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.817820:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.817840:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.817848:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.817855:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818453:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818462:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818470:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521419.818530:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818546:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818833:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818841:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818849:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521419.818854:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818864:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818881:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521419.818884:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521419.818891:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.818899:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae01693e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819241:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819251:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819258:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819265:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521419.819276:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819283:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819293:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a4fa31a00) 00010000:00010000:0.0:1788521419.819296:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521419.819299:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819306:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819329:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819337:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819345:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819351:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521419.819354:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819361:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819370:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a4fa31e00) 00010000:00010000:0.0:1788521419.819372:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521419.819381:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.819388:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01694c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521419.819514:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+19:10442:x1875400346086784:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1901us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521419.819524:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:3.0:1788521419.881971:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.882155:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346087040 00000100:00100000:1.0:1788521419.882168:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346087040 00000100:00100000:1.0:1788521419.882246:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:1.0:1788521419.882259:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+19:10445:x1875400346087040:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521419.882289:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521419.882321:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440449 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.882439:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.882458:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.882472:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.882491:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.882499:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.882524:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883088:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883098:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883107:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521419.883118:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788521419.883243:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883253:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883261:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883268:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.883274:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883283:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883300:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521419.883304:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521419.883319:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883328:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01695a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883345:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883351:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883357:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883362:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.883365:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883372:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883380:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521419.883382:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521419.883386:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.883392:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.885719:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.885884:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.885897:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:1.0:1788521419.885900:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521419.885904:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a400, rc 0) 00000100:00100000:1.0:1788521419.885991:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:10445:x1875400346087040:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3733us (4034us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788521419.886002:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:3.0:1788521419.890880:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.891023:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346087168 00000100:00100000:1.0:1788521419.891040:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346087168 00000100:00100000:1.0:1788521419.891121:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:1.0:1788521419.891133:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:10445:x1875400346087168:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1788521419.891234:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891257:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891271:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891307:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891316:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891339:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891345:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521419.891350:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891359:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891373:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:1.0:1788521419.891377:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521419.891383:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.891389:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.891498:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:10445:x1875400346087168:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 365us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521419.891508:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:3.0:1788521419.899607:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.900989:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346087424 00000100:00100000:1.0:1788521419.901007:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346087424 00000100:00100000:1.0:1788521419.901095:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1788521419.901108:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a88850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:10445:x1875400346087424:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521419.901855:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a88850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:10445:x1875400346087424:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 744us (2267us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788521419.901865:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1788521419.944124:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.944194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346087680 00000100:00100000:0.0:1788521419.944209:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346087680 00000100:00100000:0.0:1788521419.944294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:0.0:1788521419.944307:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+22:9972:x1875400346087680:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1788521419.944342:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521419.944374:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01697d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440450 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.944520:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.944540:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.944553:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.944611:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.944645:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 23 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521419.944664:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab37100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368128768:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521419.944833:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521419.951895:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.956036:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346087808 00000100:00100000:3.0:1788521419.956056:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346087808 00010000:00010000:3.0:1788521419.956122:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 24 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.956190:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1788521419.956203:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:2345:x1875400346087808:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521419.956222:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521419.956230:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 24 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956246:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 24 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956275:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521419.956281:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956292:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956319:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956348:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521419.956432:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:2345:x1875400346087808:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 231us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.956440:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00010000:00010000:3.0:1788521419.956509:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440449 expref: 23 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521419.956528:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab37100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368128768:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521419.956557:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956568:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956573:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521419.956605:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788521419.956832:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae01697d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956850:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.956859:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521419.956869:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521419.956872:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c5800, rc 0) 00000100:00100000:3.0:1788521419.956901:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+23:9972:x1875400346087680:12345-192.168.203.48@tcp:101:bash.0 Request processed in 12597us (12792us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788521419.960509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1788521419.963017:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521419.963164:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088064 00000100:00100000:0.0:1788521419.963178:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088064 00000100:00100000:0.0:1788521419.963249:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:0.0:1788521419.963261:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:9972:x1875400346088064:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1788521419.963617:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.963638:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521419.963654:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521419.963717:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788521419.963743:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8291bbf reply state 000000007cc911bf transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521419.963752:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788521419.963828:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788521419.963960:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+27:9972:x1875400346088064:12345-192.168.203.48@tcp:36:bash.0 Request processed in 701us (956us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788521419.963969:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000020:00080000:0.0:1788521419.963974:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788521419.971770:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.971894:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.971902:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.971909:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521419.971915:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.971924:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.971947:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521419.971951:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521419.971957:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.971965:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016992 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521419.972084:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.974902:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088192 00000100:00100000:3.0:1788521419.974998:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088192 00000100:00100000:3.0:1788521419.975227:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:3.0:1788521419.975239:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+26:9972:x1875400346088192:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521419.975272:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521419.975300:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016999 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440457 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.975378:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440457 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.975396:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440457 expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521419.975420:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521419.975423:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521419.975428:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521419.975504:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+27:9972:x1875400346088192:12345-192.168.203.48@tcp:101:bash.0 Request processed in 267us (3426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521419.975512:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:0.0:1788521419.980610:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521419.980696:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088320 00000100:00100000:1.0:1788521419.980714:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088320 00000100:00100000:1.0:1788521419.980943:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1788521419.980959:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:9972:x1875400346088320:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521419.980987:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521419.981020:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644045e expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521419.981058:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9aabca, atime: 0x6a9aabc8, ctime: 0x6a9aabca, blocks: 0xb 00010000:00010000:1.0:1788521419.981086:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788521419.981091:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521419.981102:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.981124:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521419.981138:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b600, rc 0) 00000100:00100000:1.0:1788521419.981224:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:9972:x1875400346088320:12345-192.168.203.48@tcp:101:bash.0 Request processed in 271us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521419.981233:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1788521419.987292:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521419.987381:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088448 00000100:00100000:3.0:1788521419.987396:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088448 00002000:00010000:3.0:1788521419.987452:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788521419.987457:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7ab35c00 with x1875400346088448 ext(0->18446744073709551615) 00002000:00010000:3.0:1788521419.987473:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7ab35c00. 00000100:00100000:3.0:1788521419.987514:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1788521419.987527:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346088448:12345-192.168.203.48@tcp:10:bash.0 00002000:00010000:3.0:1788521419.988094:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788521419.988113:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788521418 -> 1788521419 00002000:00010000:3.0:1788521419.988116:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788521416 -> 1788521416 00002000:00010000:3.0:1788521419.988119:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788521418 -> 1788521419 00002000:00010000:3.0:1788521419.988121:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788521419.988207:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346088448:12345-192.168.203.48@tcp:10:bash.0 Request processed in 681us (933us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788521419.988216:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00010000:3.0:1788521419.988221:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1788521419.988224:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7ab35c00 with x1875400346088448 ext(0->18446744073709551615) 00002000:00010000:3.0:1788521419.988229:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7ab35c00. 00000100:00100000:2.0:1788521420.050413:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.050543:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088576 00000100:00100000:0.0:1788521420.050558:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088576 00000100:00100000:0.0:1788521420.050655:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:0.0:1788521420.050668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+27:10459:x1875400346088576:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1788521420.050813:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.050839:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.050855:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.050875:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.050884:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.050892:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051188:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051198:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051206:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521420.051273:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051286:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051294:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051302:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051308:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521420.051312:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051321:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051334:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521420.051337:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:1.0:1788521420.051509:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788521420.051545:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051553:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0169a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051568:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051575:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051588:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051602:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521420.051605:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051613:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051622:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a4fa31e00) 00010000:00010000:0.0:1788521420.051624:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521420.051627:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051632:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0169ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051649:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051656:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051662:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051667:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521420.051669:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051684:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051692:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:0.0:1788521420.051694:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521420.051696:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.051702:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae0169b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521420.052068:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+27:10459:x1875400346088576:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1399us (1668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521420.052078:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:0.0:1788521420.104273:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521420.104400:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088832 00000100:00100000:1.0:1788521420.104414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088832 00000100:00100000:1.0:1788521420.104494:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:1.0:1788521420.104524:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+27:10462:x1875400346088832:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521420.104553:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521420.104582:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0169bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440465 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.104694:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.104713:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.104726:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.104744:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.104752:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.104760:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.105552:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0169d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.105566:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0169d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.105574:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0169d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521420.105609:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788521420.105742:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.105751:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.105758:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.105765:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521420.106155:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106167:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106184:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521420.106188:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521420.106195:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106202:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0169c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106220:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106227:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106246:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106251:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521420.106255:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106261:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106269:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a42b1c500) 00010000:00010000:1.0:1788521420.106272:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521420.106275:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.106281:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0169ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.107351:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0169bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440465 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.107378:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0169d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440465 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.107388:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:1.0:1788521420.107391:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788521420.107395:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b200, rc 0) 00000100:00100000:1.0:1788521420.107642:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+29:10462:x1875400346088832:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3119us (3381us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788521420.107665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:2.0:1788521420.116038:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.116119:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346088960 00000100:00100000:3.0:1788521420.116134:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346088960 00000100:00100000:3.0:1788521420.116371:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:3.0:1788521420.116385:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+29:10462:x1875400346088960:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521420.116735:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.116760:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.116811:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.116858:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 29 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.116876:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 29 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.116917:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6052a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368128896:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521420.117056:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a454eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521420.120835:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.121037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346089216 00000100:00100000:0.0:1788521420.121114:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346089216 00000100:00100000:0.0:1788521420.121188:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1788521420.121199:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+30:5586:x1875400346089216:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788521420.122015:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+31:5586:x1875400346089216:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 813us (1237us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788521420.122026:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1788521420.122245:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6052a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368128896:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521420.122280:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.125648:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521420.125814:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346089344 00000100:00100000:2.0:1788521420.125829:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346089344 00010000:00010000:2.0:1788521420.127636:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 31 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.127874:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1788521420.127899:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+31:2346:x1875400346089344:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521420.127919:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521420.127928:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 31 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.127944:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 31 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.127974:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016984 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440450 expref: 31 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.127998:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:1.0:1788521420.128004:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.128015:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.128024:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.128293:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521420.128400:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+30:2346:x1875400346089344:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 513us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521420.128409:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00010000:00010000:3.0:1788521420.132406:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132429:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132476:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132484:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132492:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132499:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.132505:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132514:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132537:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521420.132559:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521420.132673:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.132682:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.132830:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+29:10462:x1875400346088960:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 16442us (16802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.132842:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1788521420.143388:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521420.143542:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346089600 00000100:00100000:1.0:1788521420.143556:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346089600 00000100:00100000:1.0:1788521420.143636:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1788521420.143649:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+29:10462:x1875400346089600:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521420.144206:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+30:10462:x1875400346089600:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 558us (830us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788521420.144215:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1788521420.245651:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.246501:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346089856 00000100:00100000:3.0:1788521420.246517:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346089856 00000100:00100000:3.0:1788521420.246608:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:3.0:1788521420.246621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+30:10473:x1875400346089856:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:3.0:1788521420.246656:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.246685:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644046c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.246821:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.246842:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.246856:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.246876:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.246884:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.246907:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247266:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0169fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247277:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0169fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247284:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0169fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521420.247295:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788521420.247447:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247456:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247463:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247469:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.247473:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247481:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247494:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521420.247497:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.247509:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247516:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae0169ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247530:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247536:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247541:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247546:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.247549:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247553:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247561:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4200) 00010000:00010000:3.0:1788521420.247563:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.247566:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247571:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0169f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247651:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae0169e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644046c expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247679:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0169fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644046c expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.247687:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:3.0:1788521420.247690:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521420.247693:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1000, rc 0) 00000100:00100000:3.0:1788521420.247834:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+32:10473:x1875400346089856:12345-192.168.203.48@tcp:101:cat.0 Request processed in 1214us (2197us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788521420.247843:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:2.0:1788521420.257398:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.258722:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346090112 00000100:00100000:0.0:1788521420.258744:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346090112 00000100:00100000:0.0:1788521420.258894:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1788521420.258907:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+32:10473:x1875400346090112:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:0.0:1788521420.259614:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+33:10473:x1875400346090112:12345-192.168.203.48@tcp:35:cat.0 Request processed in 703us (2225us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788521420.259643:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1788521420.274916:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521420.275074:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346090368 00000100:00100000:2.0:1788521420.275087:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346090368 00000100:00100000:2.0:1788521420.275174:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:2.0:1788521420.275196:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+33:10474:x1875400346090368:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:2.0:1788521420.275285:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521420.275324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0169fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644046c expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275353:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0169d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440465 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275368:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016999 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440457 expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275380:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a42b1cc00) 00010000:00010000:2.0:1788521420.275393:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521420.275600:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275621:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275634:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275654:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275675:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.275683:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.276619:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.276633:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.276642:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521420.283331:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788521420.283352:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341361577346ns, next at 342361572701ns, rc = 0 00010000:00010000:2.0:1788521420.283470:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283492:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283508:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283518:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283524:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283549:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283582:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521420.283622:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283628:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283636:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283642:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beba00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521420.283647:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283654:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521420.283655:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283662:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283669:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a46737700) 00010000:00010000:2.0:1788521420.283672:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788521420.283676:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521420.283678:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283679:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283685:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283686:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283695:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8c0a46737700) 00010000:00010000:3.0:1788521420.283697:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788521420.283700:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283705:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016a1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283718:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283721:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521420.283724:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.283731:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521420.283733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521420.283735:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283740:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521420.283743:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283750:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283759:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521420.283761:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521420.283765:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.283771:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016a09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521420.283805:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075ad7511 reply state 000000006aa86560 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521420.283816:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521420.285206:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+32:10474:x1875400346090368:12345-192.168.203.48@tcp:36:rm.0 Request processed in 9999us (10292us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788521420.285223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00010000:00010000:1.0:1788521420.288439:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.288465:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.288474:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.288482:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521420.288488:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.288498:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.288521:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a46737600) 00010000:00010000:1.0:1788521420.288525:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521420.288531:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.288539:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016a10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.339318:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.339449:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346090624 00000100:00100000:3.0:1788521420.339463:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346090624 00000100:00100000:3.0:1788521420.339535:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:3.0:1788521420.339548:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+31:10480:x1875400346090624:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521420.339594:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.339624:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440473 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.339848:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.339869:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.339884:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.339903:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.339910:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.339917:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521420.340669:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788521420.340938:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.340965:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.340976:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341025:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341034:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341042:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341048:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.341053:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341061:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341079:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521420.341083:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.341088:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341096:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016a2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521420.341110:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005680c8fc reply state 000000000aa5ac1a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.341127:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788521420.341168:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341184:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.341192:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:3.0:1788521420.341194:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521420.341197:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521420.341299:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+34:10480:x1875400346090624:12345-192.168.203.48@tcp:101:bash.0 Request processed in 1752us (1995us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788521420.341308:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00010000:00010000:3.0:1788521420.345407:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.345428:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.345438:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.345444:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.345450:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.345460:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.345500:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4200) 00010000:00010000:3.0:1788521420.345503:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.345509:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.345517:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.351172:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.351233:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346090752 00000100:00100000:3.0:1788521420.351247:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346090752 00000100:00100000:3.0:1788521420.352038:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1788521420.352055:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2346:x1875400346090752:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521420.352085:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.352114:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644047a expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521420.352151:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521420.352179:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1788521420.352184:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521420.352195:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.352220:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.352236:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0000, rc 0) 00000100:00100000:3.0:1788521420.352311:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346090752:12345-192.168.203.48@tcp:101:bash.0 Request processed in 262us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.352334:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00080000:0.0:1788521420.355306:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521420.360729:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521420.361098:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346090880 00000100:00100000:1.0:1788521420.361113:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346090880 00000100:00100000:1.0:1788521420.361257:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1788521420.361270:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:10480:x1875400346090880:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521420.361297:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521420.361324:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440481 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.361369:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.361380:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521420.361386:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521420.361392:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.361436:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.361453:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 7 pid: 6693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.361471:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a4641aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875400368129024:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521420.361665:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4593b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521420.372623:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521420.373148:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346091008 00000100:00100000:2.0:1788521420.373161:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346091008 00010000:00010000:2.0:1788521420.373217:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 8 pid: 6693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521420.373294:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:2.0:1788521420.373306:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346091008:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521420.373326:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521420.373366:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 8 pid: 6693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.373382:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 8 pid: 6693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.373414:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521420.373419:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521420.373431:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.373443:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.373488:0:8520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521420.373504:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8520:1875400368129152:192.168.203.48@tcp:105: 00000100:00100000:2.0:1788521420.373653:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc30c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788521420.374198:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000369508d2/0x53df1cebae016a48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644047a expref: 8 pid: 6693 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.374216:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a4641aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875400368129024:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521420.374245:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.374259:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575ac00, rc 0) 00000100:00100000:3.0:1788521420.374300:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:10480:x1875400346090880:12345-192.168.203.48@tcp:101:bash.0 Request processed in 13033us (13585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.374308:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1788521420.380949:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.381128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346091264 00000100:00100000:0.0:1788521420.381142:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346091264 00000100:00100000:0.0:1788521420.381222:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1788521420.381233:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+33:10480:x1875400346091264:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1788521420.381733:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+34:10480:x1875400346091264:12345-192.168.203.48@tcp:35:bash.0 Request processed in 499us (797us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788521420.381742:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1788521420.388508:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8520:1875400368129152:192.168.203.48@tcp:105: 00010000:00010000:2.0:1788521420.388564:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521420.391280:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46424050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346091008:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 17956us (18653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521420.391300:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1788521420.399527:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521420.399564:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521420.399668:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521420.400217:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368129280 00000100:00100000:1.0:1788521420.400229:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368129280 00000100:00100000:1.0:1788521420.400305:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788521420.400316:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875400368129280:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521420.400728:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788521420.400858:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521420.401233:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1875400368129280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 917us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521420.401243:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521420.401400:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a46418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368129280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521420.548381:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.548598:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346091392 00000100:00100000:3.0:1788521420.548612:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346091392 00000100:00100000:2.0:1788521420.548800:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:2.0:1788521420.548820:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+34:10496:x1875400346091392:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521420.548863:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521420.548912:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440488 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.549003:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016a5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.549022:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.549038:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521420.549085:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788521420.549089:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521420.549113:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016a5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.549164:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440488 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.549186:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016a5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440488 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.549214:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521420.549217:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521420.549222:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00100000:2.0:1788521420.549318:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+35:10496:x1875400346091392:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 504us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521420.549326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:2.0:1788521420.555156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521420.555551:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346091648 00000100:00100000:1.0:1788521420.555568:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346091648 00000100:00100000:1.0:1788521420.555659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1788521420.555672:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+35:10496:x1875400346091648:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521420.555712:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521420.555746:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016a64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644048f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.555921:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.555940:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.555956:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521420.555970:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788521420.556149:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016a64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644048f expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.556187:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644048f expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.556198:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:1.0:1788521420.556202:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521420.556206:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575aa00, rc 0) 00000100:00100000:1.0:1788521420.556294:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+37:10496:x1875400346091648:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 624us (1151us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788521420.556303:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1788521420.561397:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.561557:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346091904 00000100:00100000:3.0:1788521420.561571:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346091904 00000100:00100000:3.0:1788521420.561666:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:3.0:1788521420.561680:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+37:10496:x1875400346091904:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521420.561739:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.561829:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440496 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.561997:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.562017:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.562043:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521420.562064:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788521420.562247:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440496 expref: 40 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.562269:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440496 expref: 39 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.562280:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:3.0:1788521420.562283:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521420.562287:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0000, rc 0) 00000100:00100000:3.0:1788521420.562373:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+39:10496:x1875400346091904:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 696us (994us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788521420.562381:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:2.0:1788521420.573862:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.573992:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092032 00000100:00100000:0.0:1788521420.574007:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092032 00000100:00100000:0.0:1788521420.574113:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1788521420.574127:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+39:2346:x1875400346092032:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521420.574153:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521420.574197:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644048f expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.574252:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:0.0:1788521420.574261:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521420.574355:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+38:2346:x1875400346092032:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 232us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521420.574364:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1788521420.578494:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.578654:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092160 00000100:00100000:3.0:1788521420.578668:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092160 00000100:00100000:3.0:1788521420.578750:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1788521420.578763:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346092160:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:3.0:1788521420.578862:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.578889:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.578900:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521420.578919:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521420.578925:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.578971:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.578989:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 6 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.579007:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6052a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875400368129408:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521420.579126:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a454eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788521420.583561:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.583745:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6052a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875400368129408:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521420.583827:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.584149:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092288 00000100:00100000:1.0:1788521420.584159:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092288 00002000:00100000:1.0:1788521420.584230:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c0a48f59180 x1875400346092288/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:421/0 lens 504/0 e 0 to 0 dl 1788521431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521420.584242:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a48f59180 with x1875400346092288 ext(0->8) 00010000:00010000:1.0:1788521420.584251:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 7 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.584271:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 7 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521420.584279:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a48f59180 00000100:00100000:1.0:1788521420.584323:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1788521420.584333:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346092288:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:1.0:1788521420.585407:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:2345:x1875400346092288:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 1069us (1857us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788521420.585426:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00100000:1.0:1788521420.585436:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8c0a48f59180 x1875400346092288/t4294967302(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:421/0 lens 504/448 e 0 to 0 dl 1788521431 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521420.585445:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a48f59180 with x1875400346092288 ext(0->8) 00010000:00010000:1.0:1788521420.585453:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 9 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.585467:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 9 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521420.585475:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a48f59180 00000100:00100000:1.0:1788521420.591995:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.592077:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092416 00000100:00100000:0.0:1788521420.592090:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092416 00010000:00010000:0.0:1788521420.592148:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 9 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.592204:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1788521420.592215:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+9:2346:x1875400346092416:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521420.592235:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788521420.592260:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788521420.592263:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788521420 00002000:00010000:0.0:1788521420.592266:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788521420 00002000:00010000:0.0:1788521420.592268:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788521420 00010000:00010000:0.0:1788521420.592276:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 9 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.592314:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 9 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.592358:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae016a4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440481 expref: 9 pid: 6692 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.592378:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521420.592383:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521420.592390:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.592401:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.592446:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521420.592509:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346092416:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 296us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521420.592518:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00010000:00010000:3.0:1788521420.592622:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592633:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592666:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592676:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592684:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592706:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521420.592710:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592720:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592733:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.592742:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091e9c879/0x53df1cebae016a8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.592832:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346092160:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 14071us (14353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.592841:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:2.0:1788521420.598922:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521420.599866:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092672 00000100:00100000:1.0:1788521420.599884:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092672 00000100:00100000:1.0:1788521420.599983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:1.0:1788521420.599996:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a44850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+38:10496:x1875400346092672:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:1.0:1788521420.600103:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440496 expref: 38 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521420.600504:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788521420.600554:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788521420.601020:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788521420.601086:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.601115:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.601126:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.601171:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 42 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.601190:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 42 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.601209:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7acc9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875400368129536:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521420.601328:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4593bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521420.612175:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521420.612458:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7acc9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875400368129536:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521420.612495:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.619833:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092800 00000100:00100000:3.0:1788521420.619858:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092800 00010000:00010000:3.0:1788521420.619924:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 43 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.620036:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1788521420.620059:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+43:2345:x1875400346092800:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521420.620087:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521420.620097:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 43 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.620114:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 43 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.620143:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016a3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440473 expref: 43 pid: 5834 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.620179:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:1.0:1788521420.620186:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.620318:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.620329:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.620372:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521420.620449:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+42:2345:x1875400346092800:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 402us (8291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521420.620458:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00010000:00010000:3.0:1788521420.621310:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.621323:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521420.621515:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788521420.621818:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788521420.621955:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368129664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788521420.622740:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521420.622809:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48ac8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788521420.624754:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368129664 00000100:00100000:1.0:1788521420.624929:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368129664 00000100:00100000:1.0:1788521420.625013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788521420.625025:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875400368129664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788521420.625695:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875400368129664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 669us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521420.625706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521420.626561:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368129664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788521420.627502:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788521420.627639:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368129792:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788521420.627719:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521420.627762:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50eb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521420.627904:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368129792 00000100:00100000:1.0:1788521420.627914:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368129792 00000100:00100000:1.0:1788521420.627980:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788521420.627991:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875400368129792:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788521420.628492:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5836:x1875400368129792:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 501us (772us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788521420.628514:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788521420.628714:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a48f5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368129792:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788521420.628825:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788521420.628880:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.628895:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.628903:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.628910:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521420.628916:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.628938:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.628961:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:2.0:1788521420.628975:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788521420.628983:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521420.628990:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae016a95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521420.629400:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788521420.629580:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788521420.629607:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341707832542ns, next at 342707829239ns, rc = 0 00000001:00080000:2.0:1788521420.629616:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788521420.629658:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4e00) 00010000:00010000:2.0:1788521420.629661:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788521420.629670:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016a80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440496 expref: 46 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521420.629831:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a44850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+45:10496:x1875400346092672:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 29838us (30925us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788521420.629842:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000020:00080000:2.0:1788521420.629847:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788521420.636916:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.637410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346092928 00000100:00100000:3.0:1788521420.637424:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346092928 00000100:00100000:3.0:1788521420.637492:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:3.0:1788521420.637504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+45:10496:x1875400346092928:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521420.637537:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.637567:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644049d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.637659:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644049d expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.637679:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644049d expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.637704:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521420.637721:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521420.637726:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521420.637880:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+46:10496:x1875400346092928:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 377us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.637888:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:1.0:1788521420.641258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.641381:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346093184 00000100:00100000:3.0:1788521420.641395:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346093184 00000100:00100000:3.0:1788521420.641493:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1788521420.641505:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+46:10496:x1875400346093184:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521420.641899:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+47:10496:x1875400346093184:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 395us (657us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788521420.641907:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1788521420.770400:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.770554:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346093312 00000100:00100000:3.0:1788521420.770567:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346093312 00000100:00100000:3.0:1788521420.770652:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:3.0:1788521420.770664:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+47:10506:x1875400346093312:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1788521420.770838:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.770861:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.770876:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.770895:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.770903:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.770927:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771046:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771055:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771063:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521420.771116:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771132:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771138:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771146:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771152:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.771158:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771167:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771182:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521420.771192:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.771200:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771207:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016aa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771224:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771230:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771236:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771242:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.771245:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771251:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771258:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521420.771261:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.771263:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771268:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771285:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771298:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771306:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771311:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.771314:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771984:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.771995:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521420.771998:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.772002:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.772009:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.772121:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+47:10506:x1875400346093312:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1455us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.772132:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 101 00010000:00010000:2.0:1788521420.777448:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521420.815149:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.815269:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346093568 00000100:00100000:3.0:1788521420.815285:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346093568 00000100:00100000:3.0:1788521420.815382:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:3.0:1788521420.815397:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+47:10509:x1875400346093568:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521420.815425:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.815470:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404a4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.815601:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.815624:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.815641:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.815661:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.815669:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.815676:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816159:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816170:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816178:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521420.816190:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788521420.816488:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816514:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816521:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816529:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.816535:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816545:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816562:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521420.816566:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.816572:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816579:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016abf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816605:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816613:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816620:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816626:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.816635:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816643:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816652:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521420.816655:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521420.816658:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.816665:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.817039:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.817057:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.817066:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521420.817068:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521420.817071:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521420.817162:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+49:10509:x1875400346093568:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1767us (2027us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788521420.817171:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:0.0:1788521420.821045:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.821103:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346093696 00000100:00100000:3.0:1788521420.821118:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346093696 00000100:00100000:3.0:1788521420.821207:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:3.0:1788521420.821221:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+49:10509:x1875400346093696:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521420.821337:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821358:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821374:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821412:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821420:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821427:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821433:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521420.821438:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821446:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821459:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521420.821462:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521420.821466:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.821473:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.821575:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+49:10509:x1875400346093696:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 357us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521420.821591:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:2.0:1788521420.823454:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.823561:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346093952 00000100:00100000:3.0:1788521420.823573:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346093952 00000100:00100000:3.0:1788521420.823715:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1788521420.823729:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+49:10509:x1875400346093952:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521420.824109:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+50:10509:x1875400346093952:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 383us (666us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788521420.824117:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1788521420.916517:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.916906:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346094208 00000100:00100000:0.0:1788521420.916922:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346094208 00000100:00100000:0.0:1788521420.917010:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:0.0:1788521420.917023:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+50:10519:x1875400346094208:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1788521420.917062:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521420.917067:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521420.917122:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016a5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440488 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.917146:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:0.0:1788521420.917153:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521420.917171:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016ae2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404ab expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.917342:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.917360:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.917371:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.917426:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.917505:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 50 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.917522:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368129920:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521420.918052:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521420.923831:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5834:1875400368129920:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521420.923876:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.927468:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521420.927565:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346094336 00000100:00100000:0.0:1788521420.927581:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346094336 00010000:00010000:0.0:1788521420.927662:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 51 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.927740:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:0.0:1788521420.927755:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+51:2345:x1875400346094336:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521420.927803:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521420.927814:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 51 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.927831:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 51 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.927869:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404a4 expref: 51 pid: 5833 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.927890:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:0.0:1788521420.927896:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.927906:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.927915:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.927956:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521420.928056:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+50:2345:x1875400346094336:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 303us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521420.928064:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00010000:00010000:3.0:1788521420.929578:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.929613:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521420.929648:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788521420.930566:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016ae2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.930608:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.930619:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521420.930623:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521420.930628:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6ee00, rc 0) 00000100:00100000:3.0:1788521420.930965:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+50:10519:x1875400346094208:12345-192.168.203.48@tcp:101:bash.0 Request processed in 13942us (14463us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788521420.930987:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:1.0:1788521420.934518:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.934693:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346094592 00000100:00100000:3.0:1788521420.934947:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346094592 00000100:00100000:0.0:1788521420.935173:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:0.0:1788521420.935187:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+50:10519:x1875400346094592:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1788521420.935595:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.935944:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.935961:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521420.936039:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788521420.936069:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c3d98b8 reply state 000000002f5c43e9 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.936081:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521420.936288:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+53:10519:x1875400346094592:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1102us (1782us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788521420.936298:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 105 00000020:00080000:0.0:1788521420.936304:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788521420.940405:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.940581:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346094720 00000100:00100000:3.0:1788521420.940606:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346094720 00000100:00100000:3.0:1788521420.940707:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:3.0:1788521420.940720:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+53:10519:x1875400346094720:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521420.940767:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521420.940825:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404b2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.940951:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.940974:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.940983:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.940991:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.941015:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.941074:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521420.941102:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521420.941118:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368130048:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521420.941225:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a454eb000 going to sleep for 11 seconds 00010000:00010000:0.0:1788521420.942618:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942635:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942644:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942671:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521420.942676:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942685:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942718:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:0.0:1788521420.942722:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521420.942726:0:3287:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942739:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.942754:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016af7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521420.944943:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.945055:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368130048:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521420.945095:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.945182:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346094848 00000100:00100000:0.0:1788521420.945191:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346094848 00010000:00010000:0.0:1788521420.945233:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521420.945280:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1788521420.945291:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+54:2345:x1875400346094848:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521420.945308:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521420.945327:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.945360:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.945389:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae016ae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ab expref: 54 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.945406:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:0.0:1788521420.945411:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.945424:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.945444:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521420.945472:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521420.945541:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+53:2345:x1875400346094848:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 251us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521420.945549:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00010000:00010000:1.0:1788521420.946885:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.946900:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521420.946967:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788521420.946972:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521420.946999:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.947047:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.947069:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521420.947079:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521420.947082:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521420.947098:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4000, rc 0) 00000100:00100000:1.0:1788521420.947171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+52:10519:x1875400346094720:12345-192.168.203.48@tcp:101:bash.0 Request processed in 6452us (6785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521420.947182:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:1.0:1788521420.950855:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521420.950972:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346095104 00000100:00100000:3.0:1788521420.950986:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346095104 00000100:00100000:3.0:1788521420.951089:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1788521420.951101:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+52:10519:x1875400346095104:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:3.0:1788521420.951495:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+53:10519:x1875400346095104:12345-192.168.203.48@tcp:35:bash.0 Request processed in 395us (654us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788521420.951505:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1788521421.014764:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.015172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346095232 00000100:00100000:2.0:1788521421.015200:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346095232 00000100:00100000:2.0:1788521421.015267:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:2.0:1788521421.015279:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+53:10525:x1875400346095232:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521421.015320:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521421.015352:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404b9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.015565:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.015591:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.015606:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521421.015654:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788521421.015658:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521421.015680:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.015708:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b9 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.015991:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b9 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.016002:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521421.016006:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521421.016011:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beba00, rc 0) 00000100:00100000:2.0:1788521421.016100:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346095232:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 823us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.016108:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:1.0:1788521421.018963:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.019068:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346095360 00000100:00100000:3.0:1788521421.019080:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346095360 00000100:00100000:3.0:1788521421.019192:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:3.0:1788521421.019204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346095360:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521421.019233:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521421.019262:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016b1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404c0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019364:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019381:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019394:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019411:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019418:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019424:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019534:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019542:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019549:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521421.019608:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788521421.019613:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521421.019636:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019664:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019674:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019681:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019688:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019694:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521421.019708:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019718:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019838:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521421.019843:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521421.019849:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019857:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016b21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019875:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019881:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019894:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019899:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521421.019903:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019909:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019918:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521421.019920:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521421.019924:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019930:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019964:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016b1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c0 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019979:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c0 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.019986:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521421.019988:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521421.019991:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0000, rc 0) 00000100:00100000:3.0:1788521421.020071:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+55:10525:x1875400346095360:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 870us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.020087:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:3.0:1788521421.023119:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.023296:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346095488 00000100:00100000:0.0:1788521421.023311:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346095488 00000100:00100000:0.0:1788521421.023404:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1788521421.023417:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+55:2346:x1875400346095488:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521421.023445:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521421.023480:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016b2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c0 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.023520:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:0.0:1788521421.023526:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521421.023715:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+54:2346:x1875400346095488:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 300us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.023733:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1788521421.023964:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.024037:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346095744 00000100:00100000:2.0:1788521421.024044:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346095744 00000100:00100000:2.0:1788521421.024093:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:2.0:1788521421.024102:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346095744:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521421.024123:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521421.024144:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404c7 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.024278:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.024296:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.024306:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.024352:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.024368:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 55 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.024383:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368130176:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521421.024480:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50eb4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521421.027177:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368130176:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521421.027221:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521421.028039:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.028260:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346095872 00000100:00100000:0.0:1788521421.028271:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346095872 00010000:00010000:0.0:1788521421.028324:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.028371:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:0.0:1788521421.028383:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60aea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+56:2346:x1875400346095872:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521421.028401:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521421.028409:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.028424:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.028455:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016b05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b2 expref: 56 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.028476:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:0.0:1788521421.028481:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.028505:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.028515:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.028549:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521421.028630:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60aea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+55:2346:x1875400346095872:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 248us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.028638:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00010000:00010000:2.0:1788521421.028763:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.028790:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521421.028820:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788521421.029072:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 56 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.029091:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 55 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.029099:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521421.029102:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521421.029104:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea400, rc 0) 00000100:00100000:2.0:1788521421.029141:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+55:10525:x1875400346095744:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 5040us (5177us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788521421.029149:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:1.0:1788521421.036185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.036309:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346096128 00000100:00100000:2.0:1788521421.036324:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346096128 00000100:00100000:2.0:1788521421.036406:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:2.0:1788521421.036419:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+55:10525:x1875400346096128:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:2.0:1788521421.036442:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521421.036494:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644049d expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.036520:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521421.036527:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521421.036665:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346096128:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 247us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.036674:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1788521421.039551:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521421.041686:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346096256 00000100:00100000:1.0:1788521421.041716:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346096256 00000100:00100000:1.0:1788521421.042035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:1.0:1788521421.042049:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346096256:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:1.0:1788521421.042215:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.042239:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.042255:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521421.042516:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788521421.042937:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346096256:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 887us (3397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521421.042947:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:2.0:1788521421.045433:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.045530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346096384 00000100:00100000:3.0:1788521421.045543:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346096384 00000100:00100000:3.0:1788521421.045654:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:3.0:1788521421.045668:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+54:10525:x1875400346096384:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521421.045694:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521421.045731:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404ce expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.045987:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.046004:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.046030:0:5832:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.046050:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.046069:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521421.046073:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521421.046077:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.046086:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1200, rc 0) 00000100:00100000:3.0:1788521421.046196:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+55:10525:x1875400346096384:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 531us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.046205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 111 00000040:00080000:3.0:1788521421.545150:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521421.545168:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521421.545243:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788521421.545254:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521421.545725:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368130304:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521421.546639:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a454eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521421.555971:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521421.556073:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346096512 00000100:00100000:1.0:1788521421.556086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346096512 00000100:00100000:1.0:1788521421.556184:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:1.0:1788521421.556196:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346096512:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788521421.556264:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521421.556318:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368130304:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521421.556403:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+55:10526:x1875400346096512:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 208us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521421.556412:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:0.0:1788521421.564968:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.565368:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346096640 00000100:00100000:2.0:1788521421.565386:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346096640 00000100:00100000:2.0:1788521421.565476:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:2.0:1788521421.565490:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+55:10526:x1875400346096640:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.565628:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.565659:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566347:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566381:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566392:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566400:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566453:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566464:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566471:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521421.566538:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788521421.566543:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521421.566561:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566574:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566593:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566602:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566610:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.566615:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566626:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.566643:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:2.0:1788521421.566653:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521421.566660:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567537:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016b59 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567563:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567570:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567588:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567595:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.567599:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567607:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567619:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8c0a46737800) 00010000:00010000:2.0:1788521421.567622:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521421.567626:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567633:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b60 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.567652:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.568251:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.568259:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.568267:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.568270:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.568279:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.568291:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521421.568294:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521421.568298:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.568304:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.568450:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+55:10526:x1875400346096640:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 2957us (3688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.568461:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:0.0:1788521421.593480:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521421.593610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346096896 00000100:00100000:1.0:1788521421.593622:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346096896 00000100:00100000:1.0:1788521421.593714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:1.0:1788521421.593725:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+55:10526:x1875400346096896:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521421.593959:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521421.593989:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016b6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404d5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594126:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594145:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594159:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521421.594173:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788521421.594291:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594300:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594307:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594326:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521421.594331:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594339:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594354:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521421.594358:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788521421.594364:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594370:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594422:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016b6e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404d5 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594433:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:1.0:1788521421.594435:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521421.594440:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016b6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404d5 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.594449:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521421.594533:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346096896:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 810us (1067us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788521421.594542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:1.0:1788521421.603348:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.603511:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346097024 00000100:00100000:3.0:1788521421.603526:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346097024 00000100:00100000:3.0:1788521421.603983:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:3.0:1788521421.604002:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346097024:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521421.604053:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521421.604272:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346097024:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 276us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.604281:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:0.0:1788521421.610981:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.613371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346097280 00000100:00100000:2.0:1788521421.613391:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346097280 00000100:00100000:2.0:1788521421.613485:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:2.0:1788521421.613498:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346097280:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.613528:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521421.613547:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788521421.613596:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404b9 expref: 56 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.613621:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521421.613628:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521421.613653:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404dc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521421.615231:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788521421.615663:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.616139:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.616158:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.616251:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404dc expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.616275:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404dc expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.616284:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a46737800) 00010000:00010000:2.0:1788521421.616287:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521421.616291:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea200, rc 0) 00000100:00100000:2.0:1788521421.616466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+57:10526:x1875400346097280:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2969us (5499us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788521421.616496:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:0.0:1788521421.625404:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.628997:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346097536 00000100:00100000:2.0:1788521421.629019:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346097536 00000100:00100000:2.0:1788521421.629262:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:2.0:1788521421.629276:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+57:10526:x1875400346097536:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.629366:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521421.629405:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016b8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404dc expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629432:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a46737800) 00010000:00010000:2.0:1788521421.629449:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521421.629480:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629501:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629513:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629532:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629539:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629546:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629682:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629692:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629708:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629716:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.629722:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629740:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.629750:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:2.0:1788521421.629753:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521421.629757:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631260:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016b98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631285:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631291:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631298:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631322:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beba00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.631327:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631337:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631353:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xaf46c609 (ffff8c0a46737000) 00010000:00010000:2.0:1788521421.631356:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521421.631361:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.631367:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016b9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xaf46c609 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.631509:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346097536:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 2231us (6113us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521421.631519:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:1.0:1788521421.636535:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.636682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346097664 00000100:00100000:3.0:1788521421.636703:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346097664 00000100:00100000:3.0:1788521421.637263:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:3.0:1788521421.637281:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+56:10526:x1875400346097664:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521421.637311:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521421.637361:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404e3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.637435:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.637454:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.637470:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.637616:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.637641:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.637652:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521421.637655:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788521421.637660:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1000, rc 0) 00000100:00100000:3.0:1788521421.637811:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+57:10526:x1875400346097664:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 534us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.637820:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:0.0:1788521421.643323:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.643420:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346097920 00000100:00100000:3.0:1788521421.643435:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346097920 00000100:00100000:3.0:1788521421.643514:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:3.0:1788521421.643527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+57:10526:x1875400346097920:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521421.643679:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.643740:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.643767:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521421.647318:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788521421.647344:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342725570038ns, next at 343725563693ns, rc = 0 00000004:00010000:0.0:1788521421.647516:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036d20b81 reply state 00000000ba4d9cdc transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.647532:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521421.648252:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+59:10526:x1875400346097920:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 4717us (4945us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788521421.648265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00010000:00010000:3.0:1788521421.651690:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.651721:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.651730:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.651751:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521421.651764:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.651818:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.651844:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521421.651848:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521421.651854:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.651862:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016bb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.653387:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.654268:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346098048 00000100:00100000:3.0:1788521421.654298:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346098048 00000100:00100000:3.0:1788521421.654438:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:3.0:1788521421.654449:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+58:10526:x1875400346098048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521421.654481:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521421.654511:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404ea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.654600:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.654618:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.654645:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521421.654648:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521421.654652:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0c00, rc 0) 00000100:00100000:3.0:1788521421.655539:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+59:10526:x1875400346098048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 303us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.655554:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:0.0:1788521421.673602:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.674098:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346098176 00000100:00100000:3.0:1788521421.674112:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346098176 00000100:00100000:3.0:1788521421.674210:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1788521421.674225:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346098176:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788521421.674664:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+9:2346:x1875400346098176:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 441us (1088us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788521421.674683:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00080000:0.0:1788521421.675129:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521421.694902:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.695137:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346098432 00000100:00100000:3.0:1788521421.695172:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346098432 00000100:00100000:3.0:1788521421.695267:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:3.0:1788521421.695280:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+59:10526:x1875400346098432:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521421.695650:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:10526:x1875400346098432:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 371us (760us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788521421.695659:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:2.0:1788521421.706599:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.706999:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346098688 00000100:00100000:0.0:1788521421.707013:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346098688 00000100:00100000:0.0:1788521421.707093:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:0.0:1788521421.707108:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+60:10526:x1875400346098688:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521421.707270:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+60:10526:x1875400346098688:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 166us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.707279:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:1.0:1788521421.714322:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.714440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346098816 00000100:00100000:2.0:1788521421.714454:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346098816 00000100:00100000:2.0:1788521421.714526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:2.0:1788521421.714538:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:10526:x1875400346098816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.714564:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521421.714605:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404f1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.714692:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.714734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.714959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521421.715372:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521421.715398:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.715434:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f1 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.715455:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f1 expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.715465:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521421.715469:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788521421.715473:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea200, rc 0) 00000100:00100000:2.0:1788521421.715556:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+61:10526:x1875400346098816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1020us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.715564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:1.0:1788521421.721399:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.721506:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346098944 00000100:00100000:2.0:1788521421.721519:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346098944 00000100:00100000:2.0:1788521421.721637:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:2.0:1788521421.721651:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+9:2345:x1875400346098944:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.721679:0:8219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521421.721738:0:8219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404f8 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788521421.721807:0:8219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aabcd, blocks: 0x1 00010000:00010000:2.0:1788521421.721837:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1788521421.721842:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521421.721855:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 10 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.721879:0:8219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 10 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.721896:0:8219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb000, rc 0) 00000100:00100000:2.0:1788521421.721978:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+10:2345:x1875400346098944:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 330us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.721986:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:0.0:1788521421.725622:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.725723:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099200 00000100:00100000:2.0:1788521421.725745:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099200 00000100:00100000:2.0:1788521421.725850:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:2.0:1788521421.725862:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+61:10526:x1875400346099200:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788521421.726005:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+61:10526:x1875400346099200:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 146us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.726014:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:1.0:1788521421.739928:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.740029:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099328 00000100:00100000:3.0:1788521421.740042:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099328 00000100:00100000:3.0:1788521421.740126:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1788521421.740139:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:10526:x1875400346099328:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521421.740166:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521421.740191:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64404ff expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.740236:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 11 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.740247:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521421.740252:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521421.740258:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.740306:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 11 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.740324:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 11 pid: 8219 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521421.740359:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875400368130432:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521421.740477:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a454eb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521421.746136:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.746280:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099456 00000100:00100000:0.0:1788521421.746291:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099456 00010000:00010000:0.0:1788521421.746348:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 12 pid: 8219 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.746403:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1788521421.746414:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+12:2346:x1875400346099456:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521421.746433:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521421.746463:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 12 pid: 8219 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.746479:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 12 pid: 8219 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.746514:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521421.746520:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521421.746531:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.746565:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.746632:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.746650:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875400368130560:192.168.203.48@tcp:105: 00000100:00100000:0.0:1788521421.746818:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00010000:00010000:3.0:1788521421.747393:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bd0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f8 expref: 12 pid: 8219 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521421.747414:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875400368130432:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521421.747451:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.747463:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1e00, rc 0) 00000100:00100000:3.0:1788521421.747504:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+11:10526:x1875400346099328:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 7368us (7594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.747514:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1788521421.754499:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.754630:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099584 00000100:00100000:2.0:1788521421.754643:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099584 00002000:00100000:2.0:1788521421.754723:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c0a7ab61880 x1875400346099584/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:422/0 lens 504/0 e 0 to 0 dl 1788521432 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521421.754766:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7ab61880 with x1875400346099584 ext(0->12) 00002000:00010000:2.0:1788521421.754994:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7ab61880 00000100:00100000:2.0:1788521421.755037:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1788521421.755049:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+11:2345:x1875400346099584:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788521421.756363:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875400368130560:192.168.203.48@tcp:105: 00010000:00010000:1.0:1788521421.756406:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521421.756525:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:2345:x1875400346099584:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 1475us (2037us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788521421.756536:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00002000:00100000:2.0:1788521421.756548:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8c0a7ab61880 x1875400346099584/t4294967308(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:422/0 lens 504/448 e 0 to 0 dl 1788521432 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521421.756560:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7ab61880 with x1875400346099584 ext(0->12) 00002000:00010000:2.0:1788521421.756566:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7ab61880 00000100:00100000:1.0:1788521421.757405:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+12:2346:x1875400346099456:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 10987us (11283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521421.757418:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1788521421.760696:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.760832:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099712 00000100:00100000:0.0:1788521421.760848:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099712 00000100:00100000:0.0:1788521421.760928:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:0.0:1788521421.760940:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+61:10526:x1875400346099712:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788521421.801613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788521421.824677:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000020:00080000:1.0:1788521421.824723:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a44d2f600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788521421.824737:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a6dd8cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a44d2f240 00000020:00080000:1.0:1788521421.824741:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a6dd8cf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a5826e400 00000001:00080000:1.0:1788521421.824763:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:1.0:1788521421.824820:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:1.0:1788521421.824830:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1788521421.824844:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:1.0:1788521421.824856:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1788521421.824860:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788521421.824884:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a48ac8180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788521421.824887:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a50557600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a48ac8e40 00000020:00080000:1.0:1788521421.824889:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a50557b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a4fa23400 00000020:00080000:0.0:1788521421.825158:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788521421.825367:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788521421.825711:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521421.825995:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368130944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788521421.826065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521421.826131:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788521421.826137:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368130816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788521421.826165:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521421.826195:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368130944 00000100:00100000:2.0:1788521421.826201:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368130944 00000100:00100000:2.0:1788521421.826250:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368130816 00000100:00100000:2.0:1788521421.826254:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368130816 00000100:00100000:2.0:1788521421.826273:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521421.826282:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368130944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788521421.826433:0:8219:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788521421.826437:0:8219:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788521421 00002000:00010000:2.0:1788521421.826454:0:8219:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788521421.826457:0:8219:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788521421 -> 1788521421 00002000:00010000:2.0:1788521421.826459:0:8219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788521421.826686:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3301:x1875400368130944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 404us (621us total) trans 4294967309 rc 0/0 00000004:00080000:0.0:1788521421.826860:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fe1500/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788521421.826866:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368130944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788521421.826991:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788521421.827199:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368130688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788521421.827247:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.827296:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788521421.827306:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368130816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788521421.827327:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788521421.827351:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.827373:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.827388:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788521421.827392:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521421.827398:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.827428:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 11 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.827442:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 11 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.827455:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368131072:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521421.827533:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f15900 going to sleep for 11 seconds 00000100:00080000:0.0:1788521421.827546:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521421.828136:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368130688 00000100:00100000:2.0:1788521421.828144:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368130688 00000100:00100000:2.0:1788521421.828171:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788521421.828179:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875400368130688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788521421.828194:0:8219:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788521421.828219:0:8219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9aabcc, atime: 0x6a9aabcc, ctime: 0x6a9aabcc, blocks: 0x1 00010000:00010000:2.0:1788521421.828225:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.828234:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1788521421.828238:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521421.828244:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.828258:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.828268:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.828275:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.828300:0:8219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521421.829493:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3302:x1875400368130688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1302us (2233us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788521421.829505:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788521421.829588:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521421.829597:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.829609:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521421.829614:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.829624:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.829659:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.829668:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d790d8c0/0x53df1cebae016be5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.829690:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521421.829692:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521421.829693:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521421.830344:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+15:10526:x1875400346099712:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 69403us (69660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.830354:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:0.0:1788521421.831605:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab62d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368131072:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521421.831636:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521421.832216:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fe0e00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788521421.832224:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368130688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788521421.833084:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.833169:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099840 00000100:00100000:2.0:1788521421.833177:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099840 00000100:00100000:2.0:1788521421.833229:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:2.0:1788521421.833239:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+12:2346:x1875400346099840:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788521421.842948:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.846093:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346099968 00000100:00100000:0.0:1788521421.846109:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346099968 00010000:00010000:0.0:1788521421.846157:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 13 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.846206:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:0.0:1788521421.846217:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:2347:x1875400346099968:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521421.846235:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521421.846241:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 13 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.846278:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 13 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.846305:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070c25d9c/0x53df1cebae0169a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644045e expref: 13 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.846323:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521421.846327:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521421.846334:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.846344:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.846382:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521421.846455:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+12:2347:x1875400346099968:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 240us (3520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.846463:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00010000:00010000:2.0:1788521421.846574:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.846594:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.846605:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.846614:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.846640:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521421.847615:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521421.847625:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.847636:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6ee00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521421.847641:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.847669:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.847686:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.847694:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008fe90939/0x53df1cebae016bde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.847732:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521421.847733:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521421.847735:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521421.849181:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3301:x1875400368130816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21871us (23008us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788521421.849195:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1788521421.849716:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fe2a00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788521421.849725:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368130816:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788521421.874070:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:1.0:1788521421.874088:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788521421.874269:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346099840:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 41025us (41184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.874282:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1788521421.877992:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.878087:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346100224 00000100:00100000:2.0:1788521421.878098:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346100224 00000100:00100000:2.0:1788521421.878158:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:2.0:1788521421.878168:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+15:10526:x1875400346100224:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.878223:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521421.878248:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404f1 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.878269:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521421.878274:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521421.878304:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.878317:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.878329:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521421.878590:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018ba5ab6 reply state 00000000d502a0ec transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.878600:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521421.879060:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+16:10526:x1875400346100224:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 891us (1142us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788521421.879067:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 125 00010000:00010000:1.0:1788521421.881156:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.881173:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.881180:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.881186:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521421.881191:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.881198:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.881214:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521421.881217:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521421.881222:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521421.881229:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016bec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521421.885690:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.886158:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346100352 00000100:00100000:3.0:1788521421.886171:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346100352 00000100:00100000:3.0:1788521421.886247:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:3.0:1788521421.886259:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346100352:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788521421.886491:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788521421.886496:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788521421 -> 1788521420 00002000:00010000:3.0:1788521421.886515:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788521420 00002000:00010000:3.0:1788521421.886517:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788521421 -> 1788521420 00002000:00010000:3.0:1788521421.886519:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788521421.886663:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346100352:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 405us (986us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788521421.886673:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1788521421.890211:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.890315:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346100608 00000100:00100000:2.0:1788521421.890325:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346100608 00000100:00100000:2.0:1788521421.890416:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:2.0:1788521421.890426:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+15:10526:x1875400346100608:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.890494:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.890511:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.890520:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.890555:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.890569:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 15 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.890663:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368131200:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521421.890936:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521421.894547:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.894652:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346100736 00000100:00100000:3.0:1788521421.894664:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346100736 00010000:00010000:3.0:1788521421.894719:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521421.894769:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1788521421.894804:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+16:2345:x1875400346100736:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521421.894823:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521421.894832:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.894847:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.894874:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521421.894880:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.894890:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.894899:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.894954:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521421.895018:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+16:2345:x1875400346100736:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 215us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.895025:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00010000:00010000:2.0:1788521421.895509:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016bad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404e3 expref: 15 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.895608:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368131200:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521421.895764:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895860:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895868:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895898:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895904:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895912:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895918:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.895922:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895930:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895942:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521421.895945:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788521421.895949:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.895956:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016bf3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.896445:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:10526:x1875400346100608:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 6017us (6239us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788521421.896455:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:0.0:1788521421.899991:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.900143:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346100864 00000100:00100000:2.0:1788521421.900157:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346100864 00000100:00100000:2.0:1788521421.900228:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1788521421.900240:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346100864:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.900296:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.900325:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.900334:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521421.900338:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521421.900343:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.900384:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.900400:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 7 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.900415:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368131328:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521421.900532:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521421.903669:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368131328:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521421.903713:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.905358:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.905431:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346100992 00000100:00100000:2.0:1788521421.905440:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346100992 00010000:00010000:2.0:1788521421.905479:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 8 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.905523:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:2.0:1788521421.905534:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346100992:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521421.905549:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521421.905572:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 8 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.905597:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 8 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.905617:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091e9c879/0x53df1cebae016bd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ff expref: 8 pid: 6692 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.905634:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521421.905639:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521421.905645:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.905679:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.905721:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521421.905803:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346100992:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 271us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.905811:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00010000:00010000:0.0:1788521421.906750:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906764:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906827:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906837:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906859:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906867:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521421.906872:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906883:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906898:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.906907:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba0a7ccd/0x53df1cebae016bfa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521421.907141:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346100864:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 6902us (7161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.907150:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:0.0:1788521421.909671:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.909764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346101248 00000100:00100000:2.0:1788521421.909817:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346101248 00000100:00100000:2.0:1788521421.909882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1788521421.909894:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+14:10526:x1875400346101248:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521421.910060:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910080:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910094:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910337:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910349:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910358:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910411:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.910427:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 15 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.910444:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368131456:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521421.910548:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788521421.915813:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521421.916213:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368131456:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521421.916250:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521421.916363:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346101376 00000100:00100000:3.0:1788521421.916371:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346101376 00010000:00010000:3.0:1788521421.916409:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521421.916481:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:3.0:1788521421.916492:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+16:2346:x1875400346101376:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521421.916509:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521421.916517:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.916529:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.916551:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016bbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ea expref: 16 pid: 5834 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.916569:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521421.916573:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.916600:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.916627:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.916661:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521421.916745:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+15:2346:x1875400346101376:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 253us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.916753:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00010000:00010000:2.0:1788521421.916822:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.916829:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521421.918361:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788521421.918554:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788521421.918615:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788521421.919035:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368131584:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521421.919103:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521421.919142:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788521421.919227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368131584 00000100:00100000:0.0:1788521421.919235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368131584 00000100:00100000:0.0:1788521421.919291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521421.919301:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368131584:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788521421.919378:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368131584:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.919393:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521421.919476:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788521421.919482:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788521421.919500:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fe1500, transno 4294967309 00000100:00100000:2.0:1788521421.919528:0:5832:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8c0a81fe2a00 x1875400368130816/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521437 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521421.919541:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368131584:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788521421.920471:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788521421.920534:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368131712:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521421.920572:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521421.921145:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521421.921220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368131712 00000100:00100000:0.0:1788521421.921229:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368131712 00000100:00100000:0.0:1788521421.921282:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521421.921291:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368131712:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788521421.921486:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5832:x1875400368131712:12345-0@lo:1000:mdt00_000.0 Request processed in 196us (913us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788521421.921494:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521421.921602:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368131712:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788521421.921644:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.921655:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.921663:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.921669:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beba00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.921674:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.921682:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922253:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521421.922258:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521421.922264:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922272:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c08 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922327:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922334:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922340:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922345:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.922348:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922355:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922364:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521421.922366:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521421.922374:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922388:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922398:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.922438:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.922465:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368131840:192.168.203.48@tcp:105: 00000100:00100000:2.0:1788521421.922564:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521421.926446:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.926523:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346101504 00000100:00100000:3.0:1788521421.926535:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346101504 00000100:00100000:3.0:1788521421.926608:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1788521421.926620:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+19:10525:x1875400346101504:12345-192.168.203.48@tcp:49:lfs.0 00000100:00100000:2.0:1788521421.926870:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368131840:192.168.203.48@tcp:105: 00010000:00010000:2.0:1788521421.926907:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.926919:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016b4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927195:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927213:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927229:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927240:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927246:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927253:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927259:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.927265:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927290:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927304:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521421.927307:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521421.927311:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927317:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927327:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927333:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927340:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927346:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521421.927348:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927354:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927362:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521421.927364:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521421.927367:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.927383:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.927727:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:10526:x1875400346101248:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 17832us (18067us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788521421.927747:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000020:00080000:2.0:1788521421.927754:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788521421.927894:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:10525:x1875400346101504:12345-192.168.203.48@tcp:49:lfs.0 Request processed in 1274us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521421.927902:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000040:00080000:0.0:1788521421.931741:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521421.931755:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521421.932292:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788521421.932305:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521421.934359:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368132096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.934435:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.934470:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368132608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.934496:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.934523:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788521421.934529:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368131968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.934554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.934604:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368132480:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.934625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.934651:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368132224:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.934673:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.934691:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521421.935023:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368132352:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.935054:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521421.935093:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368132608 00000100:00100000:0.0:1788521421.935102:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368132608 00000100:00100000:0.0:1788521421.935149:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368132352 00000100:00100000:0.0:1788521421.935152:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368132352 00000100:00100000:0.0:1788521421.935176:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521421.935184:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875400368132608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.935237:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1875400368132608:12345-0@lo:400:kworker.0 Request processed in 53us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.935245:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788521421.935264:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521421.935271:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3300:x1875400368132352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.935299:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3300:x1875400368132352:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521421.935304:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521421.935339:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368132352:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.935366:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368132608:0@lo:400:kworker.0 00000100:00100000:0.0:1788521421.935427:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.935458:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521421.935491:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346101760 00000100:00100000:0.0:1788521421.935495:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346101760 00000100:00100000:0.0:1788521421.935525:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:0.0:1788521421.935532:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a45c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+18:10526:x1875400346101760:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521421.935770:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368131968 00000100:00100000:2.0:1788521421.935789:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368131968 00000100:00100000:2.0:1788521421.935818:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788521421.935825:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368131968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.935873:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368131968:12345-0@lo:400:kworker.0 Request processed in 48us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.935878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788521421.936077:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368131968:0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.936100:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368132096 00000100:00100000:2.0:1788521421.936103:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368132096 00000100:00100000:2.0:1788521421.936123:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368132480 00000100:00100000:2.0:1788521421.936126:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368132480 00000100:00080000:2.0:1788521421.936145:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521421.936160:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368132224 00000100:00100000:2.0:1788521421.936163:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368132224 00000100:00080000:2.0:1788521421.936176:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521421.936187:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346102016 00000100:00100000:2.0:1788521421.936190:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346102016 00000100:00100000:2.0:1788521421.936204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788521421.936210:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368132096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.936263:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368132096:12345-0@lo:400:kworker.0 Request processed in 53us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.936269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788521421.936293:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368132096:0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.936309:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788521421.936315:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368132480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.936350:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368132480:12345-0@lo:400:kworker.0 Request processed in 35us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.936356:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788521421.936378:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368132480:0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.936396:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788521421.936403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368132224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521421.936436:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368132224:12345-0@lo:400:kworker.0 Request processed in 35us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.936442:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788521421.936455:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:2.0:1788521421.936460:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:10525:x1875400346102016:12345-192.168.203.48@tcp:58:lfs.0 00000100:00100000:0.0:1788521421.936641:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368132224:0@lo:400:kworker.0 00000004:00080000:0.0:1788521421.939646:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521421.941137:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788521421.941229:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.941250:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.941266:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.941276:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.941283:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.941291:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521421.941312:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:2.0:1788521421.943384:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788521421.943503:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:10525:x1875400346102016:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 7036us (8038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521421.943516:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:1.0:1788521421.944748:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368132736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521421.944840:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521421.944890:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368132736 00000100:00100000:1.0:1788521421.944899:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368132736 00000100:00100000:1.0:1788521421.944959:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521421.944969:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368132736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521421.944997:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788521421.945045:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368132736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521421.945052:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788521421.945106:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368132736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788521421.948179:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521421.948195:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.948207:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521421.948212:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.948223:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.948244:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8c0a4fa31e00) 00010000:00010000:3.0:1788521421.948248:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788521421.948252:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.948276:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016c16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521421.948302:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521421.948304:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521421.948306:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521421.949151:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a45c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:10526:x1875400346101760:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 13607us (13714us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788521421.949167:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000020:00080000:0.0:1788521421.949176:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788521421.981337:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521421.981404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346102144 00000100:00100000:3.0:1788521421.981417:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346102144 00000100:00100000:3.0:1788521421.981487:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:3.0:1788521421.981499:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:10528:x1875400346102144:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521421.981527:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521421.981549:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016c1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440506 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.982897:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.982919:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.983016:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.985438:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.985465:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.985478:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.986335:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.986352:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 21 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.986360:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.986404:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 21 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521421.986422:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 21 pid: 6713 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521421.986440:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368132864:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521421.986612:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788521421.997872:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521421.997945:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346102400 00000100:00100000:1.0:1788521421.997956:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346102400 00000100:00100000:1.0:1788521421.998021:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1788521421.998114:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:5586:x1875400346102400:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788521421.998400:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+23:5586:x1875400346102400:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 370us (1380us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788521421.998409:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:3.0:1788521421.999430:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368132864:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521421.999468:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521422.001345:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521422.001445:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346102528 00000100:00100000:2.0:1788521422.001456:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346102528 00010000:00010000:2.0:1788521422.001518:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 23 pid: 6713 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521422.001560:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:2.0:1788521422.001571:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+23:2345:x1875400346102528:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521422.001608:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521422.001616:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 23 pid: 6713 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521422.001631:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 23 pid: 6713 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521422.001654:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016b3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404c7 expref: 23 pid: 6713 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521422.001672:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521422.001676:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521422.001685:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521422.001702:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521422.001725:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521422.001821:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60ae8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+22:2345:x1875400346102528:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 252us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521422.001847:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00080000:3.0:1788521422.002969:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521422.003007:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003020:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521422.003205:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788521422.003210:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521422.003235:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003267:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003279:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003286:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003294:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003300:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521422.003305:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003314:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003330:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:3.0:1788521422.003333:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521422.003337:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003343:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003358:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003365:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003381:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003386:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521422.003389:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003395:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003403:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8c0a46737400) 00010000:00010000:3.0:1788521422.003406:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521422.003409:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003415:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003459:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016c1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440506 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003474:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440506 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.003483:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521422.003486:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521422.003488:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beba00, rc 0) 00000100:00100000:3.0:1788521422.003564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+21:10528:x1875400346102144:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 22067us (22235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521422.003592:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 129 00000001:00080000:1.0:1788521422.031305:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788521422.031336:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788521422.031347:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:0.0:1788521422.827650:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521422.951057:0:12063:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521422.951067:0:12063:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521422.951115:0:12063:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788521422.951121:0:12063:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788521422.956298:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521422.956307:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521422.956343:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788521422.956349:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521422.956487:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368132992:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521422.956658:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4628ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521422.959516:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368132992:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521422.961764:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521422.962905:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346102656 00000100:00100000:3.0:1788521422.962916:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346102656 00000100:00100000:3.0:1788521422.962992:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:3.0:1788521422.963003:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:10539:x1875400346102656:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521422.963037:0:6713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521422.963156:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:10539:x1875400346102656:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 155us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521422.963164:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:1.0:1788521422.984054:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521422.984168:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346102912 00000100:00100000:1.0:1788521422.984177:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346102912 00000100:00100000:1.0:1788521422.984898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:1.0:1788521422.984909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:10539:x1875400346102912:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521422.984928:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521422.985019:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644050d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.985192:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.985207:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.985399:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521422.985414:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788521422.985542:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644050d expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.985560:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644050d expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.985582:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521422.985592:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521422.985597:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a600, rc 0) 00000100:00100000:1.0:1788521422.985737:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:10539:x1875400346102912:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 828us (1691us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788521422.985745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:1.0:1788521422.990919:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521422.991419:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346103040 00000100:00100000:3.0:1788521422.991429:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346103040 00000100:00100000:3.0:1788521422.991495:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521422.991505:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:2345:x1875400346103040:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521422.991519:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521422.991543:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644050d expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521422.991560:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521422.991585:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521422.991648:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+22:2345:x1875400346103040:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 144us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521422.991655:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521422.997943:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521422.998054:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346103296 00000100:00100000:1.0:1788521422.998063:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346103296 00000100:00100000:1.0:1788521422.998133:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:1.0:1788521422.998143:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+22:10539:x1875400346103296:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788521422.998224:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998242:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998254:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998462:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998471:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998476:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998482:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521422.998486:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998499:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998511:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521422.998514:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521422.998518:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521422.998525:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016c4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521422.998684:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+23:10539:x1875400346103296:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 542us (749us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788521422.998693:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000040:00080000:1.0:1788521422.998935:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521422.998940:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521422.999445:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788521422.999453:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521423.005246:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521423.007345:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346103552 00000100:00100000:2.0:1788521423.007359:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346103552 00000100:00100000:2.0:1788521423.007433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:2.0:1788521423.007445:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:10539:x1875400346103552:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788521423.007706:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:10539:x1875400346103552:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 261us (2466us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788521423.007714:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00010000:00010000:3.0:1788521423.849250:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521423.982312:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521423.982367:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521423.982481:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346103680 00000100:00100000:3.0:1788521423.982490:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346103680 00000100:00100000:3.0:1788521423.982555:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 289 00000100:00100000:3.0:1788521423.982576:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346103680:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521423.982644:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346103680:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521423.982650:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 289 00000100:00100000:1.0:1788521423.987121:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521423.987527:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521423.987599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346103808 00000100:00100000:2.0:1788521423.987610:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346103808 00000100:00100000:2.0:1788521423.987684:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:2.0:1788521423.987701:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:2347:x1875400346103808:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521423.987838:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:2347:x1875400346103808:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 144us (5470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521423.987845:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:1.0:1788521423.990497:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521423.990702:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104192 00000100:00100000:2.0:1788521423.990721:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104192 00000100:00100000:2.0:1788521423.990814:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:2.0:1788521423.990826:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346104192:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521423.990909:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346104192:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 85us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521423.990917:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00080000:1.0:1788521423.991191:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521423.991605:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346103936 00000100:00100000:3.0:1788521423.991611:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346103936 00000100:00100000:3.0:1788521423.991698:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104064 00000100:00100000:3.0:1788521423.991702:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104064 00000100:00100000:2.0:1788521423.991751:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:2.0:1788521423.991761:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346103936:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521423.991834:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346103936:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 75us (4722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521423.991842:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00080000:1.0:1788521423.995155:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521423.995169:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521423.995654:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:3.0:1788521423.995669:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346104064:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521423.996106:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346104064:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 441us (8579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521423.996114:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:1.0:1788521424.872960:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521424.900270:0:12115:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521424.900280:0:12115:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521424.900327:0:12115:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788521424.900333:0:12115:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521425.151168:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521425.151220:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104448 00000100:00100000:2.0:1788521425.151229:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104448 00000100:00100000:2.0:1788521425.151302:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:2.0:1788521425.151314:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:10561:x1875400346104448:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521425.151333:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521425.151356:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440514 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521425.151473:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521425.151491:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521425.151505:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521425.151518:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788521425.151821:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440514 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521425.151856:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440514 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521425.151865:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:2.0:1788521425.151868:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788521425.151872:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea200, rc 0) 00000100:00100000:2.0:1788521425.151938:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+26:10561:x1875400346104448:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 626us (777us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788521425.151945:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00080000:2.0:1788521425.151971:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521425.157987:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521425.158028:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104576 00000100:00100000:3.0:1788521425.158041:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104576 00000100:00100000:3.0:1788521425.158103:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:3.0:1788521425.158114:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+26:10561:x1875400346104576:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521425.158205:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158225:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158237:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158263:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158269:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158275:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158281:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521425.158285:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158292:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158303:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:3.0:1788521425.158306:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521425.158310:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521425.158316:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521425.158400:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+26:10561:x1875400346104576:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 288us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521425.158408:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:2.0:1788521425.271882:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521425.271984:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104704 00000100:00100000:0.0:1788521425.272009:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104704 00000100:00100000:0.0:1788521425.272084:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1788521425.272094:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346104704:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:0.0:1788521425.272112:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521425.272132:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ce2aee5/0x53df1cebae016c71 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644051b expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521425.272158:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9aabcc, atime: 0x6a9aabcc, ctime: 0x6a9aabcc, blocks: 0xb 00010000:00010000:0.0:1788521425.272177:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1788521425.272182:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521425.272191:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ce2aee5/0x53df1cebae016c71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644051b expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521425.272211:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ce2aee5/0x53df1cebae016c71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644051b expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521425.272224:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f600, rc 0) 00000100:00100000:0.0:1788521425.272287:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346104704:12345-192.168.203.48@tcp:101:cat.0 Request processed in 194us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521425.272294:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00080000:2.0:1788521425.272765:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521425.275919:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521425.276147:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104832 00000100:00100000:0.0:1788521425.276160:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104832 00002000:00100000:0.0:1788521425.276222:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8c0a81c4df80 x1875400346104832/t0(0) o3->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:426/0 lens 488/0 e 0 to 0 dl 1788521436 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521425.276235:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a81c4df80 with x1875400346104832 ext(0->4095) 00002000:00010000:0.0:1788521425.276241:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a81c4df80 00000100:00100000:0.0:1788521425.276302:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1788521425.276314:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346104832:12345-192.168.203.48@tcp:3:cat.0 00000100:00100000:0.0:1788521425.277244:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346104832:12345-192.168.203.48@tcp:3:cat.0 Request processed in 927us (1335us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788521425.277255:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00002000:00100000:0.0:1788521425.277264:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8c0a81c4df80 x1875400346104832/t0(0) o3->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:426/0 lens 488/4536 e 0 to 0 dl 1788521436 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521425.277273:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a81c4df80 with x1875400346104832 ext(0->4095) 00002000:00010000:0.0:1788521425.277278:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a81c4df80 00000100:00100000:2.0:1788521425.513225:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521425.526277:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368133120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521425.526356:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521425.527311:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133120 00000100:00100000:1.0:1788521425.527338:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133120 00000100:00100000:1.0:1788521425.527486:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788521425.527498:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368133120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521425.527541:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521425.527629:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368133120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521425.527636:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788521425.527693:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521425.528903:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788521425.528911:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1788521425.528933:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a60529f80, transno 4294967301 00000004:00080000:0.0:1788521425.528954:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788521425.528970:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fe0e00, transno 4294967304 00000100:00100000:0.0:1788521425.528985:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368133120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521425.897499:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521426.926755:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521427.052754:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368133248:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.052845:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521427.052891:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368133760:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.052917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521427.052938:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521427.052943:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368133376:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.052962:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521427.052975:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368133888:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.052997:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521427.053022:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368133504:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.053045:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521427.053061:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521427.053066:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368133632:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.053087:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521427.053119:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133888 00000100:00100000:1.0:1788521427.053127:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133888 00000100:00100000:1.0:1788521427.053174:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133632 00000100:00100000:1.0:1788521427.053177:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133632 00000100:00100000:1.0:1788521427.053198:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788521427.053205:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368133888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.053265:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368133888:12345-0@lo:400:kworker.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521427.053272:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788521427.053291:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521427.053297:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.053328:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368133632:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521427.053334:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521427.053350:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133760 00000100:00100000:1.0:1788521427.053354:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133760 00000100:00100000:1.0:1788521427.053375:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133376 00000100:00100000:1.0:1788521427.053377:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133376 00000100:00100000:1.0:1788521427.053386:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133504 00000100:00100000:1.0:1788521427.053388:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133504 00000100:00100000:1.0:1788521427.053402:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788521427.053408:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368133760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.053438:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368133760:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521427.053444:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788521427.053456:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788521427.053461:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368133376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.053487:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368133376:12345-0@lo:400:kworker.0 Request processed in 26us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521427.053492:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788521427.053502:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788521427.053508:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368133504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521427.053652:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368133248 00000100:00100000:2.0:1788521427.053657:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368133248 00000100:00100000:2.0:1788521427.053686:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788521427.053693:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521427.053726:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368133248:12345-0@lo:400:kworker.0 Request processed in 34us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521427.053731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:2.0:1788521427.053764:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521427.053768:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521427.053784:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521427.058086:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368133504:12345-0@lo:400:kworker.0 Request processed in 4568us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521427.058101:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788521427.058199:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368133632:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.058213:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368133504:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.058252:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368133376:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.058265:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368133888:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.058275:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368133248:0@lo:400:kworker.0 00000100:00100000:1.0:1788521427.058285:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368133760:0@lo:400:kworker.0 00000100:00100000:0.0:1788521427.062014:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521427.062040:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368134016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521427.062107:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521427.066679:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134016 00000100:00100000:3.0:1788521427.066694:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134016 00000100:00100000:3.0:1788521427.066747:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521427.066757:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368134016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521427.066810:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521427.066886:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368134016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (4777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521427.066893:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521427.075952:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368134016:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788521427.110468:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:1.0:1788521427.110487:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1788521427.110504:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:1.0:1788521427.110515:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1788521427.110532:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a44d2fb40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788521427.110537:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a483cbb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a44d2f840 00000020:00080000:1.0:1788521427.110552:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a483cbe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a6dfb0400 00000020:00080000:1.0:1788521427.110879:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788521427.111060:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788521427.133421:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1788521427.133441:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1788521427.945424:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521428.969140:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521429.107923:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521429.107964:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521429.107999:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521429.108029:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521429.108050:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521429.108273:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346104960 00000100:00100000:0.0:1788521429.108285:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346104960 00000100:00100000:0.0:1788521429.108362:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 291 00000100:00100000:0.0:1788521429.108374:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346104960:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521429.108448:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2348:x1875400346104960:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 77us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521429.108473:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 291 00000100:00100000:1.0:1788521429.108924:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105216 00000100:00100000:1.0:1788521429.108930:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105216 00000100:00100000:1.0:1788521429.108989:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105344 00000100:00100000:1.0:1788521429.108992:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105344 00000100:00100000:1.0:1788521429.109017:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1788521429.109025:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346105216:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521429.109073:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346105216:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 49us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521429.109080:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1788521429.109094:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1788521429.109100:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346105344:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521429.109123:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346105344:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521429.109128:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1788521429.109221:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105472 00000100:00100000:2.0:1788521429.109225:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105472 00000100:00100000:2.0:1788521429.109268:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105088 00000100:00100000:2.0:1788521429.109271:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105088 00000100:00100000:2.0:1788521429.109302:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:2.0:1788521429.109310:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346105472:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521429.109339:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2348:x1875400346105472:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521429.109346:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:2.0:1788521429.109360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00100000:2.0:1788521429.109367:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:2348:x1875400346105088:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521429.109390:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:2348:x1875400346105088:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521429.109396:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00080000:3.0:1788521429.109854:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521429.109859:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521429.109861:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521429.994560:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521430.370847:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521430.370902:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105600 00000100:00100000:2.0:1788521430.370913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105600 00000100:00100000:2.0:1788521430.370982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:2.0:1788521430.370992:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:10214:x1875400346105600:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788521430.372910:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:10214:x1875400346105600:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 1905us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521430.374026:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:3.0:1788521430.381336:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521430.383434:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105856 00000100:00100000:1.0:1788521430.383448:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105856 00000100:00100000:1.0:1788521430.383506:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1788521430.383517:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+13:10214:x1875400346105856:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521430.383929:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+14:10214:x1875400346105856:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 412us (2600us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788521430.383937:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1788521430.563940:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521430.564103:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346105984 00000100:00100000:1.0:1788521430.564121:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346105984 00000100:00100000:1.0:1788521430.564213:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:1.0:1788521430.564224:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:11014:x1875400346105984:12345-192.168.203.48@tcp:101:lsof.0 00010000:00010000:1.0:1788521430.564243:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521430.564272:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016c78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440522 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521430.564340:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521430.564372:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521430.564383:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521430.564420:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521430.564423:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521430.564461:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521430.564485:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016c78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521430.564505:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521430.564514:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521430.564526:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521430.564530:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a800, rc 0) 00000100:00100000:1.0:1788521430.564601:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+6:11014:x1875400346105984:12345-192.168.203.48@tcp:101:lsof.0 Request processed in 379us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521430.564608:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:0.0:1788521430.633471:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521430.633515:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368134144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521430.633605:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521430.633747:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134144 00000100:00100000:3.0:1788521430.633758:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134144 00000100:00100000:3.0:1788521430.633874:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788521430.633885:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368134144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521430.633928:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521430.634011:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368134144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521430.634018:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788521430.634263:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521430.634306:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368134144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521431.017184:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521431.209063:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521431.209075:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521431.209392:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788521431.209399:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788521432.041612:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521432.169571:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368134400:0@lo:400:kworker.0 00000100:00100000:2.0:1788521432.169673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521432.169676:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368134656:0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.169743:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368134272:0@lo:400:kworker.0 00000100:00100000:0.0:1788521432.177596:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521432.177766:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788521432.177799:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368134528:0@lo:400:kworker.0 00000100:00100000:0.0:1788521432.177850:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521432.177972:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134656 00000100:00100000:0.0:1788521432.177981:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134656 00000100:00100000:0.0:1788521432.178039:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521432.178049:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368134656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521432.178302:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368134656:12345-0@lo:400:kworker.0 Request processed in 252us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521432.178309:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788521432.178610:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521432.179364:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368135040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521432.179416:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521432.179466:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135040 00000100:00100000:0.0:1788521432.179473:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135040 00000100:00100000:0.0:1788521432.179527:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521432.179535:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a481ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368135040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521432.179578:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521432.179618:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a481ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368135040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521432.182895:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788521432.183591:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521432.183832:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368134656:0@lo:400:kworker.0 00000100:00100000:0.0:1788521432.183874:0:3300:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788521432.183879:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fe2a00, transno 4294967310 00000004:00080000:0.0:1788521432.183899:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788521432.183925:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f192300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368135040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521432.184165:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134400 00000100:00100000:2.0:1788521432.184173:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134400 00000100:00100000:2.0:1788521432.184213:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134528 00000100:00100000:2.0:1788521432.184216:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134528 00000100:00100000:2.0:1788521432.184325:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521432.184334:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368134400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521432.184399:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368134400:12345-0@lo:400:kworker.0 Request processed in 67us (14728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521432.184406:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788521432.184420:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788521432.184427:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368134528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521432.184461:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368134528:12345-0@lo:400:kworker.0 Request processed in 35us (6610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521432.184467:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788521432.184495:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521432.184527:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368134528:0@lo:400:kworker.0 00000100:00100000:2.0:1788521432.184907:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368134400:0@lo:400:kworker.0 00000100:00100000:2.0:1788521432.184921:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368134912:0@lo:400:kworker.0 00000100:00100000:2.0:1788521432.184962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521432.188545:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134912 00000100:00100000:1.0:1788521432.188560:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134912 00000100:00100000:1.0:1788521432.188620:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521432.188631:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368134912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.188735:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368134912:12345-0@lo:400:kworker.0 Request processed in 106us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521432.188742:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521432.188953:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368134912:0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.189003:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521432.189037:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134272 00000100:00100000:1.0:1788521432.189041:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134272 00000100:00100000:1.0:1788521432.189079:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788521432.189088:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368134272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.189120:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368134272:12345-0@lo:400:kworker.0 Request processed in 34us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521432.189126:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788521432.189169:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368134272:0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.189181:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368134784:0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.189211:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521432.189234:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368134784 00000100:00100000:1.0:1788521432.189238:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368134784 00000100:00100000:1.0:1788521432.189273:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788521432.189280:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368134784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521432.189311:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368134784:12345-0@lo:400:kworker.0 Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521432.189318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1788521432.189335:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521432.189353:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368134784:0@lo:400:kworker.0 00000001:00080000:1.0:1788521432.236037:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1788521432.236070:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788521432.236495:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788521432.236521:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1788521433.064994:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521434.090953:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521434.226377:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521434.226421:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521434.226454:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521434.226472:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521434.226505:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521434.226540:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346106496 00000100:00100000:3.0:1788521434.226549:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346106496 00000100:00100000:3.0:1788521434.226603:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346106368 00000100:00100000:3.0:1788521434.226606:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346106368 00000100:00100000:2.0:1788521434.226861:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346106240 00000100:00100000:2.0:1788521434.226866:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346106240 00000100:00100000:2.0:1788521434.226897:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346106624 00000100:00100000:2.0:1788521434.226900:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346106624 00000100:00100000:2.0:1788521434.226922:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:2.0:1788521434.226931:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:2345:x1875400346106240:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521434.227019:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:2345:x1875400346106240:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 89us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521434.227034:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:2.0:1788521434.227051:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:2.0:1788521434.227057:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:2345:x1875400346106624:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521434.227083:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:2345:x1875400346106624:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521434.227090:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:3.0:1788521434.229393:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:3.0:1788521434.229404:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346106496:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521434.229472:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346106496:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 70us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521434.229478:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:3.0:1788521434.229511:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:3.0:1788521434.229518:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346106368:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521434.229543:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346106368:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (3070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521434.229549:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:3.0:1788521434.229575:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346106112 00000100:00100000:3.0:1788521434.229582:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346106112 00000100:00080000:1.0:1788521434.229808:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521434.229813:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521434.229816:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521434.229838:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 293 00000100:00100000:1.0:1788521434.229847:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346106112:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521434.229876:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346106112:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (3420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521434.229883:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 293 00000001:02000400:3.0:1788521434.662479:0:12319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:30:32 (1788521432) 00010000:00010000:0.0:1788521435.113049:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521435.756950:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521435.756973:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368135168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521435.757041:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521435.757111:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135168 00000100:00100000:3.0:1788521435.757121:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135168 00000100:00080000:1.0:1788521435.757162:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521435.757189:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788521435.757199:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368135168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521435.757235:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521435.757505:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368135168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 306us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521435.757513:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788521435.758251:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368135168:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521436.137125:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521436.274122:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521436.274531:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346106880 00000100:00100000:2.0:1788521436.274542:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346106880 00000100:00100000:2.0:1788521436.274661:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:2.0:1788521436.274674:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:11279:x1875400346106880:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521436.274700:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521436.274724:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016c86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440529 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.274860:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.274874:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.274886:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.274903:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.274911:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.274934:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275200:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016c9b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275210:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275218:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016c9b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521436.275230:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788521436.275387:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275395:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275402:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275407:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521436.275412:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275420:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275433:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c0a4fa31600) 00010000:00010000:2.0:1788521436.275436:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521436.275448:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275455:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016c8d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275469:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275475:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275492:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275497:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521436.275500:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275506:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275513:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c0a46737500) 00010000:00010000:2.0:1788521436.275515:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521436.275518:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275524:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016c94 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275972:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016c86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440529 expref: 16 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.275998:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016c9b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440529 expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521436.276006:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:2.0:1788521436.276008:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521436.276010:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea400, rc 0) 00000100:00100000:2.0:1788521436.276072:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+15:11279:x1875400346106880:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1401us (1963us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788521436.276080:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00080000:1.0:1788521436.276838:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521436.292400:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521436.292847:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107008 00000100:00100000:1.0:1788521436.292865:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107008 00000100:00100000:1.0:1788521436.292958:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1788521436.292971:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+15:2347:x1875400346107008:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521436.292992:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521436.293027:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016c9b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440529 expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521436.293054:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:1.0:1788521436.293062:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521436.293143:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:2347:x1875400346107008:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 175us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521436.293151:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1788521436.293516:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521436.294897:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107136 00000100:00100000:1.0:1788521436.294915:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107136 00000100:00100000:1.0:1788521436.295017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:1.0:1788521436.295027:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+14:11279:x1875400346107136:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788521436.295176:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+14:11279:x1875400346107136:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 150us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521436.295185:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 138 00000040:00080000:1.0:1788521436.329465:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788521436.329489:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788521436.329538:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788521436.329547:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788521437.161981:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521437.292366:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368135424:0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.292461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521437.292535:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368135936:0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.292568:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521437.292597:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788521437.292604:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368135296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521437.292631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521437.292661:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368135808:0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.292689:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521437.292725:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135424 00000100:00100000:0.0:1788521437.292748:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135424 00000100:00100000:0.0:1788521437.292828:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788521437.292839:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368135424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.292900:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368135424:12345-0@lo:400:kworker.0 Request processed in 62us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521437.294697:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368135552:0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.294818:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521437.294857:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368136064:0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.294885:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521437.294921:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521437.294928:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368135680:0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.294952:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521437.294990:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135936 00000100:00100000:2.0:1788521437.294998:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135936 00000100:00100000:2.0:1788521437.295059:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135552 00000100:00100000:2.0:1788521437.295230:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135552 00000100:00100000:2.0:1788521437.295250:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135680 00000100:00100000:2.0:1788521437.295253:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135680 00000100:00100000:2.0:1788521437.295274:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521437.295283:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368135936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295338:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368135936:12345-0@lo:400:kworker.0 Request processed in 55us (2769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521437.295355:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788521437.295375:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788521437.295381:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368135552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295414:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368135552:12345-0@lo:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521437.295421:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788521437.295431:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788521437.295438:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368135680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295461:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368135680:12345-0@lo:400:kworker.0 Request processed in 24us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521437.295467:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788521437.295505:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135808 00000100:00100000:2.0:1788521437.295509:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135808 00000100:00100000:2.0:1788521437.295536:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368136064 00000100:00100000:2.0:1788521437.295539:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368136064 00000100:00100000:2.0:1788521437.295562:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788521437.295568:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368135808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295601:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368135808:12345-0@lo:400:kworker.0 Request processed in 34us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521437.295609:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788521437.295619:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788521437.295625:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368136064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295649:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368136064:12345-0@lo:400:kworker.0 Request processed in 25us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521437.295655:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788521437.295684:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788521437.295690:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521437.295693:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521437.295819:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f193100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368135680:0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295833:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f190a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368135552:0@lo:400:kworker.0 00000100:00100000:2.0:1788521437.295843:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368136064:0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.296056:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788521437.296177:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368135296 00000100:00100000:0.0:1788521437.296183:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368135296 00000100:00100000:0.0:1788521437.296220:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521437.296227:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368135296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521437.296260:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521437.296302:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368135296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (3670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521437.296309:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788521437.296354:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f192680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368135296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521437.296367:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368135808:0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.296379:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f190700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368135424:0@lo:400:kworker.0 00000100:00100000:0.0:1788521437.296389:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368135936:0@lo:400:kworker.0 00000001:00080000:3.0:1788521437.398629:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788521438.185994:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521438.363030:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.363177:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107264 00000100:00100000:3.0:1788521438.363188:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107264 00000100:00100000:3.0:1788521438.363259:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 139 00000100:00100000:3.0:1788521438.363269:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:11321:x1875400346107264:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521438.363300:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521438.363320:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440530 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363387:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363404:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363417:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363434:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363442:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363449:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363681:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363689:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363697:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363703:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521438.363713:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363721:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363734:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:3.0:1788521438.363738:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521438.363743:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363750:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363765:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363879:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363888:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363893:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521438.363897:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363902:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363912:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c0a65ff4200) 00010000:00010000:3.0:1788521438.363914:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521438.363921:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363927:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016cb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363967:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ca9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440530 expref: 14 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363979:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:3.0:1788521438.363982:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521438.363987:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016ca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440530 expref: 14 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.363997:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0000, rc 0) 00000100:00100000:3.0:1788521438.364064:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:11321:x1875400346107264:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 796us (1040us total) trans 0 rc 301/301 00000100:00100000:3.0:1788521438.364072:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 139 00000100:00080000:1.0:1788521438.364664:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521438.374981:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521438.381492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107520 00000100:00100000:1.0:1788521438.381505:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107520 00000100:00100000:1.0:1788521438.381581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:1.0:1788521438.381593:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+13:11321:x1875400346107520:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:1.0:1788521438.381662:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521438.381693:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440369 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.381712:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521438.381718:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521438.382715:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.382739:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.382757:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.382828:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.382848:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 5 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521438.382866:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368136192:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521438.383263:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521438.389378:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.389419:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107648 00000100:00100000:3.0:1788521438.389430:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107648 00010000:00010000:3.0:1788521438.389501:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 6 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521438.389556:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1788521438.389569:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:2346:x1875400346107648:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521438.389588:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521438.389595:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 6 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.389627:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 6 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.389658:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:3.0:1788521438.389664:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.389676:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.389685:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.389710:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521438.389792:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:22124939-1de7-45f1-ae59-b0320dc01898+6:2346:x1875400346107648:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 207us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521438.389800:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00080000:1.0:1788521438.390047:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788521438.390088:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016c7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440522 expref: 5 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521438.390106:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368136192:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521438.390129:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.390147:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.390154:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.390178:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.390189:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.390197:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521438.394109:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788521438.394131:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.394142:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.394150:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.394156:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521438.394160:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.394168:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.394184:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a42b1cd00) 00010000:00010000:0.0:1788521438.394196:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521438.394201:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.394207:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae016cbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521438.394225:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000610cf920 reply state 000000002eb329cc transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521438.394235:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521438.395151:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+14:11321:x1875400346107520:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 13551us (20173us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788521438.395163:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 140 00010000:00010000:0.0:1788521438.402758:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.402883:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.402892:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.402899:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521438.402904:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.402912:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.402931:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c0a42b1c500) 00010000:00010000:0.0:1788521438.402935:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521438.402949:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.402956:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016cc5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.549597:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.550098:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107776 00000100:00100000:3.0:1788521438.550108:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107776 00000100:00100000:3.0:1788521438.550181:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:3.0:1788521438.550192:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+13:11329:x1875400346107776:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:3.0:1788521438.550224:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521438.550256:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ccc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440537 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.550332:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016cd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.550368:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.550381:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521438.550418:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521438.550422:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521438.550445:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.550494:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016ccc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440537 expref: 15 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.550524:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440537 expref: 14 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.550539:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:3.0:1788521438.550543:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521438.550546:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0000, rc 0) 00000100:00100000:2.0:1788521438.551378:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+14:11329:x1875400346107776:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 1184us (1799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521438.551388:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:2.0:1788521438.598516:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.598806:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346107904 00000100:00100000:3.0:1788521438.598816:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346107904 00000100:00100000:3.0:1788521438.598872:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:3.0:1788521438.598893:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+14:11335:x1875400346107904:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521438.598912:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521438.598932:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644053e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599211:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599231:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599253:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599267:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599273:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599284:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599454:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599473:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.599480:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521438.599506:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788521438.599510:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521438.602685:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602714:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602722:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602730:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602736:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521438.602741:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602749:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602831:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:2.0:1788521438.602834:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521438.602840:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602847:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1e00/0x53df1cebae016ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602870:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602877:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602882:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602887:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521438.602890:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602896:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602903:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c0a65ff4200) 00010000:00010000:2.0:1788521438.602905:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521438.602908:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.602914:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae016ce8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.604243:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae016cda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644053e expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.604259:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644053e expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.604269:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521438.604272:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788521438.604275:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4000, rc 0) 00000100:00100000:2.0:1788521438.604357:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+15:11335:x1875400346107904:12345-192.168.203.48@tcp:101:bash.0 Request processed in 5465us (5849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521438.604365:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:1.0:1788521438.613756:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521438.614073:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346108160 00000100:00100000:2.0:1788521438.614084:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346108160 00000100:00100000:2.0:1788521438.614165:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:2.0:1788521438.614174:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+15:11335:x1875400346108160:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1788521438.614193:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521438.614216:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016cf6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440545 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.614332:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.614345:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.614356:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.614410:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.614418:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.614426:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521438.615038:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788521438.615185:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615195:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615204:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615235:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615242:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615249:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615254:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521438.615258:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615276:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615287:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521438.615290:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521438.615296:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615301:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016cfd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521438.615313:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1e34f67 reply state 0000000097357820 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.615321:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788521438.615349:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016cf6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615363:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.615371:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:2.0:1788521438.615373:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521438.615375:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb000, rc 0) 00000100:00100000:2.0:1788521438.619444:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+18:11335:x1875400346108160:12345-192.168.203.48@tcp:101:bash.0 Request processed in 5260us (5689us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788521438.619535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:2.0:1788521438.627397:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.627723:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346108288 00000100:00100000:3.0:1788521438.627733:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346108288 00000100:00080000:0.0:1788521438.627853:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521438.627860:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1788521438.627871:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346108288:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521438.627898:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521438.627920:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644054c expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521438.627948:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521438.627968:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788521438.627982:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521438.627992:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.628018:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 6 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.628031:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a821c4c00, rc 0) 00000100:00100000:3.0:1788521438.628090:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2347:x1875400346108288:12345-192.168.203.48@tcp:101:bash.0 Request processed in 221us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521438.628100:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00010000:00010000:1.0:1788521438.628801:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.628813:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.628820:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.628826:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521438.628831:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.628839:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.628872:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a46737d00) 00010000:00010000:1.0:1788521438.629136:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521438.629143:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.629150:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521438.634705:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521438.634852:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346108416 00000100:00100000:2.0:1788521438.634890:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346108416 00000100:00100000:2.0:1788521438.634966:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:2.0:1788521438.634987:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:11335:x1875400346108416:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1788521438.635014:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521438.635036:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440553 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.635070:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.635080:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521438.635085:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521438.635091:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.635130:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 7 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.635144:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 7 pid: 6690 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.635159:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875400368136320:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521438.635268:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e0063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521438.641347:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.641493:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346108544 00000100:00100000:3.0:1788521438.641503:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346108544 00010000:00010000:3.0:1788521438.641543:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 8 pid: 6690 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.642124:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875400368136320:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521438.642155:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.642196:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea600, rc 0) 00000100:00100000:1.0:1788521438.642326:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1788521438.642339:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346108544:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521438.642352:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521438.642375:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 8 pid: 6690 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.642389:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 8 pid: 6690 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.642411:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009170e4d6/0x53df1cebae016d19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644054c expref: 8 pid: 6690 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.642425:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521438.642429:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521438.642437:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.642447:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.642502:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521438.642516:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875400368136448:192.168.203.48@tcp:105: 00000100:00100000:2.0:1788521438.642572:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:11335:x1875400346108416:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7596us (7875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521438.642595:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1788521438.643451:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521438.649608:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.649745:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346108800 00000100:00100000:3.0:1788521438.649755:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346108800 00000100:00100000:3.0:1788521438.649868:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1788521438.649889:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+17:11335:x1875400346108800:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:3.0:1788521438.650426:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:11335:x1875400346108800:12345-192.168.203.48@tcp:35:bash.0 Request processed in 547us (826us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788521438.650434:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1788521438.656855:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5819:1875400368136448:192.168.203.48@tcp:105: 00010000:00010000:0.0:1788521438.656901:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521438.657225:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346108544:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 14887us (15885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521438.657236:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1788521438.813347:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521438.813468:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346109056 00000100:00100000:0.0:1788521438.813478:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346109056 00000100:00100000:0.0:1788521438.813558:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:0.0:1788521438.813574:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+18:11345:x1875400346109056:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521438.813643:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521438.813675:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016d27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644055a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521438.813855:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788521438.813988:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016d27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644055a expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.814002:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:0.0:1788521438.814006:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521438.814011:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016d27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644055a expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.814046:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f200, rc 0) 00000100:00100000:0.0:1788521438.814100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:11345:x1875400346109056:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 531us (761us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788521438.814108:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:3.0:1788521438.819411:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521438.819523:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346109312 00000100:00100000:1.0:1788521438.819533:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346109312 00000100:00100000:1.0:1788521438.819602:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:1.0:1788521438.819623:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:11345:x1875400346109312:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521438.820148:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:11345:x1875400346109312:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 535us (746us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788521438.820156:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:1.0:1788521438.937862:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521438.938149:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346109440 00000100:00100000:0.0:1788521438.938163:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346109440 00000100:00100000:0.0:1788521438.938285:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:0.0:1788521438.938296:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+20:11351:x1875400346109440:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521438.938316:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521438.938336:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016d35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440561 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.938403:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.938419:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.938435:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521438.938481:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788521438.938486:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521438.938510:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.938541:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae016d35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440561 expref: 22 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.938595:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440561 expref: 21 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521438.938604:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:0.0:1788521438.938607:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521438.938619:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e800, rc 0) 00000100:00100000:0.0:1788521438.938695:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:11351:x1875400346109440:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 401us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521438.938703:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:1.0:1788521438.943268:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521438.944139:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346109696 00000100:00100000:2.0:1788521438.944154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346109696 00000100:00100000:2.0:1788521438.944225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:2.0:1788521438.944235:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:11351:x1875400346109696:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521438.944254:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521438.944276:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016d43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440568 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.944391:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016d4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.944405:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.944419:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016d4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521438.944433:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521438.944603:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016d43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440568 expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.944632:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016d4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440568 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.944661:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:2.0:1788521438.944664:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521438.944668:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00100000:2.0:1788521438.944748:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:11351:x1875400346109696:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 513us (1488us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788521438.944755:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:0.0:1788521438.954500:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521438.954650:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521438.955329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110080 00000100:00100000:2.0:1788521438.955340:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110080 00000100:00100000:2.0:1788521438.955392:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00100000:2.0:1788521438.955403:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:11351:x1875400346110080:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521438.955431:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521438.955454:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644056f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.955565:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016d5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.955596:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.955608:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016d5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521438.955682:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521438.955827:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644056f expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.955868:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016d5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644056f expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.955877:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:2.0:1788521438.955880:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788521438.955884:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb600, rc 0) 00000100:00100000:2.0:1788521438.955947:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+25:11351:x1875400346110080:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 546us (1297us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788521438.956433:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00100000:3.0:1788521438.961825:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346109824 00000100:00100000:3.0:1788521438.961841:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346109824 00000100:00100000:3.0:1788521438.961927:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1788521438.961937:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+25:2346:x1875400346109824:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521438.962154:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521438.962183:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016d4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440568 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.962205:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:3.0:1788521438.962211:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521438.962313:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:2346:x1875400346109824:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 376us (7823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521438.962321:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1788521438.966379:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.968421:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110208 00000100:00100000:3.0:1788521438.968437:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110208 00000100:00100000:3.0:1788521438.968550:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1788521438.968561:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:2346:x1875400346110208:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:3.0:1788521438.968620:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.968661:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.968670:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788521438.968674:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521438.968679:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.968714:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.968729:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 6 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521438.968743:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6052a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875400368136576:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521438.968867:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521438.974101:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6052a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875400368136576:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521438.974131:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.975913:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521438.976428:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110336 00000100:00100000:1.0:1788521438.976439:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110336 00002000:00100000:1.0:1788521438.976498:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c0a75d1ad80 x1875400346110336/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:439/0 lens 504/0 e 0 to 0 dl 1788521449 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521438.976509:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a75d1ad80 with x1875400346110336 ext(0->12) 00010000:00010000:1.0:1788521438.976518:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 7 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.976556:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 7 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521438.976564:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a75d1ad80 00000100:00100000:1.0:1788521438.976611:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:1.0:1788521438.976629:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346110336:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:1.0:1788521438.977470:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:2345:x1875400346110336:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 833us (1554us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788521438.977480:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00002000:00100000:1.0:1788521438.977489:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8c0a75d1ad80 x1875400346110336/t4294967305(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:439/0 lens 504/448 e 0 to 0 dl 1788521449 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788521438.977499:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a75d1ad80 with x1875400346110336 ext(0->12) 00010000:00010000:1.0:1788521438.977506:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 9 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521438.977520:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 9 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521438.977527:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a75d1ad80 00000100:00100000:0.0:1788521438.982840:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521438.983097:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110464 00000100:00100000:3.0:1788521438.983107:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110464 00010000:00010000:3.0:1788521438.983148:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 9 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521438.983246:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1788521438.983256:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:2345:x1875400346110464:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521438.983271:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788521438.983290:0:5820:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788521438.983293:0:5820:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788521438 00002000:00010000:3.0:1788521438.983296:0:5820:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788521438 00002000:00010000:3.0:1788521438.983298:0:5820:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788521438 00010000:00010000:3.0:1788521438.983304:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 9 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.983318:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 9 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.983342:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007576fb3a/0x53df1cebae016d20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440553 expref: 9 pid: 6692 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.983357:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521438.983361:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521438.983367:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.983375:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521438.983412:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521438.983477:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346110464:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 222us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521438.983485:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00010000:00010000:2.0:1788521438.983767:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983811:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983848:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983858:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983869:0:6690:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983916:0:6690:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521438.983922:0:6690:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983935:0:6690:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983970:0:6690:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.983982:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000492ae189/0x53df1cebae016d6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.984091:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346110208:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 15528us (17718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521438.984103:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1788521438.989857:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521438.990246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110720 00000100:00100000:2.0:1788521438.990257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110720 00000100:00100000:2.0:1788521438.990315:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:2.0:1788521438.990326:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a46c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:11351:x1875400346110720:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:2.0:1788521438.990385:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016d5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644056f expref: 24 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521438.991399:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788521438.991446:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788521438.992565:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788521438.993493:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.993517:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.993527:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.993571:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521438.994109:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 28 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521438.994137:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f190700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875400368136704:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521438.994301:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e006e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521438.997194:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f190700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5835:1875400368136704:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521438.997235:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521438.999929:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.000089:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110848 00000100:00100000:2.0:1788521439.000098:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110848 00010000:00010000:2.0:1788521439.000141:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 29 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521439.000183:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:2.0:1788521439.000193:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+29:2345:x1875400346110848:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521439.000226:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521439.000233:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 29 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.000247:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 29 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.000267:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440545 expref: 29 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.000284:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:2.0:1788521439.000289:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.000299:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.000308:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.000341:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521439.000388:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60ae8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+28:2345:x1875400346110848:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 196us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.000395:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00010000:00010000:0.0:1788521439.001471:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.001485:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521439.001636:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788521439.001885:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788521439.002241:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368136832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788521439.002316:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521439.002397:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521439.004159:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368136832 00000100:00100000:2.0:1788521439.004180:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368136832 00000100:00100000:2.0:1788521439.004282:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788521439.004293:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875400368136832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1788521439.004598:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521439.004846:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1875400368136832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 553us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.004883:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788521439.005385:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368136832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788521439.007096:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1788521439.007191:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f190700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368136960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788521439.007254:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521439.007346:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e006840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521439.007390:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368136960 00000100:00100000:1.0:1788521439.007398:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368136960 00000100:00100000:1.0:1788521439.007483:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521439.007494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1875400368136960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788521439.007837:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f192680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1875400368136960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 344us (582us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788521439.007856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521439.007950:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f190700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5835:1875400368136960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788521439.008149:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788521439.008189:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.008199:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.008207:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.008213:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521439.008218:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.008226:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.008241:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:0.0:1788521439.008244:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788521439.008249:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.008254:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016d74 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521439.008433:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788521439.008553:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788521439.008563:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360086788999ns, next at 361086786957ns, rc = 0 00000001:00080000:0.0:1788521439.008569:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788521439.008619:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737600) 00010000:00010000:0.0:1788521439.008623:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788521439.008638:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016d5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644056f expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521439.009196:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a46c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+31:11351:x1875400346110720:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 18869us (19344us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788521439.009207:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000020:00080000:0.0:1788521439.009212:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788521439.014266:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.014333:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346110976 00000100:00100000:2.0:1788521439.014343:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346110976 00000100:00100000:2.0:1788521439.014408:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 148 00000100:00100000:2.0:1788521439.014419:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+31:11351:x1875400346110976:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521439.014448:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521439.014484:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440576 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.014553:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440576 expref: 32 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.014567:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440576 expref: 32 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.014596:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521439.014600:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521439.014604:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb000, rc 0) 00000100:00100000:2.0:1788521439.015148:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+32:11351:x1875400346110976:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 727us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.015157:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 148 00000100:00100000:0.0:1788521439.020854:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.021188:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346111232 00000100:00100000:3.0:1788521439.021198:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346111232 00000100:00100000:3.0:1788521439.021264:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1788521439.021275:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+32:11351:x1875400346111232:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521439.021588:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+33:11351:x1875400346111232:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 303us (730us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788521439.021598:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1788521439.116372:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521439.116562:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346111488 00000100:00100000:1.0:1788521439.116871:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346111488 00000100:00100000:1.0:1788521439.117135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:1.0:1788521439.117148:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+33:11361:x1875400346111488:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521439.117179:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521439.117213:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644057d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521439.117330:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788521439.117471:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016d82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644057d expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.117489:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:1.0:1788521439.117493:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521439.117499:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644057d expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.117518:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b600, rc 0) 00000100:00100000:1.0:1788521439.118142:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+34:11361:x1875400346111488:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 989us (1779us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788521439.118153:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:1.0:1788521439.124381:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.124485:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346111616 00000100:00100000:3.0:1788521439.124496:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346111616 00000100:00100000:3.0:1788521439.124566:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:3.0:1788521439.124589:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+34:11361:x1875400346111616:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1788521439.124690:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.124710:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.124724:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.124740:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.124769:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.124815:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125287:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125297:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125305:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521439.125356:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125371:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125378:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125385:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125391:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521439.125395:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125404:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125427:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521439.125430:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521439.125436:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125443:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016d90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125474:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125482:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125488:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125493:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521439.125496:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125502:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125509:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521439.125512:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521439.125514:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125520:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016d97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125548:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125555:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125561:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125566:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82045a00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521439.125568:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125574:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125818:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:3.0:1788521439.125822:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521439.125826:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.125833:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521439.131171:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+34:11361:x1875400346111616:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 6580us (6783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.131298:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:0.0:1788521439.135910:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.136024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346111872 00000100:00100000:2.0:1788521439.136034:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346111872 00000100:00100000:2.0:1788521439.136087:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:2.0:1788521439.136097:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+34:11361:x1875400346111872:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521439.136566:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+35:11361:x1875400346111872:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 468us (662us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788521439.136573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1788521439.175945:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.176063:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346112128 00000100:00100000:2.0:1788521439.176075:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346112128 00000100:00100000:2.0:1788521439.176149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:2.0:1788521439.176162:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+35:11364:x1875400346112128:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521439.176191:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521439.176216:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016da5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440584 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.176373:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.176389:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.176400:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.176415:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.176442:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.176449:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177367:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177381:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177390:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521439.177401:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521439.177520:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177529:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177535:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177541:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521439.177546:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.177552:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178474:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521439.178482:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521439.178488:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178497:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178516:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178522:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178528:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178532:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521439.178535:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178540:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178548:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a46737200) 00010000:00010000:2.0:1788521439.178550:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521439.178553:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016db3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178939:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016da5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178959:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.178967:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521439.178970:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521439.178972:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb400, rc 0) 00000100:00100000:2.0:1788521439.179055:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+37:11364:x1875400346112128:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 2895us (3122us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788521439.179064:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:1.0:1788521439.189225:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.189482:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346112256 00000100:00100000:2.0:1788521439.189493:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346112256 00000100:00100000:2.0:1788521439.189596:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:2.0:1788521439.189607:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+37:11364:x1875400346112256:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521439.189690:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189707:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189720:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189746:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189815:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189824:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189830:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521439.189834:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189842:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189856:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521439.189859:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521439.189864:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.189870:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521439.189950:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+37:11364:x1875400346112256:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 344us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.189958:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:0.0:1788521439.192477:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.192590:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346112512 00000100:00100000:3.0:1788521439.192600:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346112512 00000100:00100000:3.0:1788521439.192671:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1788521439.192683:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+37:11364:x1875400346112512:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521439.192938:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+38:11364:x1875400346112512:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 256us (479us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788521439.192961:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00010000:00010000:0.0:1788521439.210084:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521439.347424:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.347485:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.347524:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.347555:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521439.347576:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521439.347810:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346112640 00000100:00100000:0.0:1788521439.347823:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346112640 00000100:00100000:0.0:1788521439.347883:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 295 00000100:00100000:0.0:1788521439.347894:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346112640:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521439.347975:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46234050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2346:x1875400346112640:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 81us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521439.347981:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 295 00000100:00100000:2.0:1788521439.348211:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346112896 00000100:00100000:2.0:1788521439.348217:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346112896 00000100:00100000:2.0:1788521439.348270:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346113024 00000100:00100000:2.0:1788521439.348272:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346113024 00000100:00100000:2.0:1788521439.348306:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1788521439.348314:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346112896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521439.348370:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346112896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 57us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.348377:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1788521439.348391:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:2.0:1788521439.348397:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346113024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521439.348420:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346113024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.348427:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00080000:2.0:1788521439.348441:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521439.348479:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346112768 00000100:00100000:2.0:1788521439.348484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346112768 00000100:00100000:2.0:1788521439.348511:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346113152 00000100:00100000:2.0:1788521439.348513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346113152 00000100:00100000:2.0:1788521439.348534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:2.0:1788521439.348540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+38:2345:x1875400346112768:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521439.348580:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+38:2345:x1875400346112768:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.348587:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:2.0:1788521439.348602:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:2.0:1788521439.348607:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346113152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521439.348646:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2346:x1875400346113152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.348652:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:3.0:1788521439.506985:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.507132:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346113408 00000100:00100000:2.0:1788521439.507160:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346113408 00000100:00100000:2.0:1788521439.507243:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 153 00000100:00100000:2.0:1788521439.507254:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+38:11395:x1875400346113408:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1788521439.507277:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521439.507298:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644058b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.507401:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.507415:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.507427:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521439.507439:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521439.507568:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644058b expref: 41 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.507968:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644058b expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.507977:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521439.507979:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521439.507983:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00100000:2.0:1788521439.508056:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+40:11395:x1875400346113408:12345-192.168.203.48@tcp:101:cat.0 Request processed in 804us (1081us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788521439.508064:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 153 00000100:00100000:2.0:1788521439.512633:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.512686:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521439.512919:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346113792 00000100:00100000:1.0:1788521439.512930:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346113792 00000100:00100000:1.0:1788521439.513002:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1788521439.513030:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+40:2345:x1875400346113792:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521439.513049:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521439.513075:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644058b expref: 40 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.513097:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521439.513103:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521439.513174:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+39:2345:x1875400346113792:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 146us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521439.513181:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1788521439.513522:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346113664 00000100:00100000:0.0:1788521439.513529:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346113664 00000100:00100000:0.0:1788521439.513575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1788521439.513595:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+39:11395:x1875400346113664:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:0.0:1788521439.513896:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+40:11395:x1875400346113664:12345-192.168.203.48@tcp:35:cat.0 Request processed in 314us (1277us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788521439.513904:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1788521439.589047:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521439.589360:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346114048 00000100:00100000:0.0:1788521439.589387:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346114048 00000100:00100000:0.0:1788521439.589450:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:0.0:1788521439.589471:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+40:11401:x1875400346114048:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:0.0:1788521439.589497:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521439.589501:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788521439.589534:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440561 expref: 40 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.589553:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:0.0:1788521439.589558:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521439.589588:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016de4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440592 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.589710:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.589726:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.589735:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.589836:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.589852:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 40 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521439.589866:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e21b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368137088:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521439.590175:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788521439.596972:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e21b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368137088:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521439.597006:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521439.597472:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521439.598069:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346114176 00000100:00100000:0.0:1788521439.598078:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346114176 00010000:00010000:0.0:1788521439.598118:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 41 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521439.598166:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:0.0:1788521439.598177:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+41:2345:x1875400346114176:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521439.598197:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521439.598205:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 41 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.598219:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 41 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.598376:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440584 expref: 41 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.598394:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521439.598399:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.598409:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.598437:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.598475:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521439.598592:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+40:2345:x1875400346114176:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 402us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521439.598600:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:2.0:1788521439.598888:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.598898:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521439.598920:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788521439.599081:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016de4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.599097:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.599104:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521439.599107:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521439.599109:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f000, rc 0) 00000100:00100000:2.0:1788521439.599139:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+41:11401:x1875400346114048:12345-192.168.203.48@tcp:101:dd.0 Request processed in 9672us (10109us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788521439.599146:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:2.0:1788521439.603492:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521439.603587:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346114432 00000100:00100000:0.0:1788521439.603599:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346114432 00000100:00100000:0.0:1788521439.603671:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00100000:0.0:1788521439.603682:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+40:11401:x1875400346114432:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:0.0:1788521439.604049:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.604067:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521439.604079:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521439.604138:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788521439.604164:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057ca10cc reply state 00000000b4ecaf48 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521439.604173:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521439.604350:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+43:11401:x1875400346114432:12345-192.168.203.48@tcp:36:dd.0 Request processed in 669us (869us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788521439.604357:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 155 00000020:00080000:0.0:1788521439.604363:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788521439.607433:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.607451:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.607476:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.607482:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521439.607487:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.607496:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.607512:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:3.0:1788521439.607516:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521439.607521:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521439.607528:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae016df9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521439.957558:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521439.957817:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346114560 00000100:00100000:1.0:1788521439.957827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346114560 00000100:00100000:1.0:1788521439.957940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:1.0:1788521439.957950:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+42:11416:x1875400346114560:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:1.0:1788521439.957973:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521439.958005:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016e00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440599 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958068:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958083:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958097:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958126:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958148:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958155:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958241:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958253:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958261:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958429:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.958442:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 43 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521439.958466:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368137216:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521439.958582:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521439.962021:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521439.962150:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368137216:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521439.962182:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521439.967471:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346114816 00000100:00100000:0.0:1788521439.967488:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346114816 00000100:00100000:0.0:1788521439.967566:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1788521439.967586:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+44:5585:x1875400346114816:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788521439.968619:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+45:5585:x1875400346114816:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 1024us (6595us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788521439.968629:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1788521439.982236:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521439.982422:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346114944 00000100:00100000:1.0:1788521439.982432:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346114944 00010000:00010000:1.0:1788521439.982486:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 45 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521439.982553:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:1.0:1788521439.982565:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+45:2347:x1875400346114944:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521439.982594:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521439.982601:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 45 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.982623:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 45 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.982648:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016deb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440592 expref: 45 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.982667:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521439.982672:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.982684:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.982693:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521439.982724:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521439.982826:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+44:2347:x1875400346114944:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 211us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521439.982834:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00010000:00010000:2.0:1788521439.983016:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983032:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521439.983076:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788521439.983080:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521439.983117:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983131:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983139:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983148:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983155:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983160:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521439.983164:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983172:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983181:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521439.983184:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521439.983187:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983203:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983215:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983221:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983227:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983232:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ac00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521439.983235:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983241:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983249:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1c700) 00010000:00010000:2.0:1788521439.983252:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521439.983254:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983259:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575ac00/0x53df1cebae016e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983307:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae016e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440599 expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983321:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440599 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521439.983334:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521439.983336:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521439.983338:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b000, rc 0) 00000100:00100000:2.0:1788521439.983382:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+43:11416:x1875400346114560:12345-192.168.203.48@tcp:101:stat.0 Request processed in 25434us (25834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521439.983390:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:0.0:1788521440.073023:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.074126:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346115200 00000100:00100000:2.0:1788521440.074138:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346115200 00000100:00100000:2.0:1788521440.074227:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:2.0:1788521440.074239:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+43:11422:x1875400346115200:12345-192.168.203.48@tcp:36:truncate.0 00010000:00010000:2.0:1788521440.074329:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521440.074355:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440599 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.074374:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.074379:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521440.074588:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.074602:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.074612:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521440.074659:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788521440.074680:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004eb1450 reply state 00000000f0f89369 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521440.074698:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521440.074840:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+45:11422:x1875400346115200:12345-192.168.203.48@tcp:36:truncate.0 Request processed in 604us (1826us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788521440.074847:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 157 00000020:00080000:2.0:1788521440.074852:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788521440.075855:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788521440.077851:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.077868:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.077878:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.077885:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521440.077891:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.077899:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.077918:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521440.077921:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521440.077926:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.077955:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521440.234118:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521440.311863:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.311995:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346115328 00000100:00100000:2.0:1788521440.312007:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346115328 00000100:00100000:2.0:1788521440.312075:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 158 00000100:00100000:2.0:1788521440.312086:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+44:11436:x1875400346115328:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:2.0:1788521440.312124:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521440.312152:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405a0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312229:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312246:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312257:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312271:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312279:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312286:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312393:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312402:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312410:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521440.312446:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788521440.312464:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521440.312485:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312496:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312504:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312511:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312517:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312523:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521440.312527:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312534:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312552:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521440.312555:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521440.312560:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312567:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312581:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312588:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312594:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312599:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521440.312601:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312607:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312614:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a46737200) 00010000:00010000:2.0:1788521440.312617:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521440.312619:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312625:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312664:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312677:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.312684:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.312686:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521440.312689:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea600, rc 0) 00000100:00100000:2.0:1788521440.312742:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+45:11436:x1875400346115328:12345-192.168.203.48@tcp:101:stat.0 Request processed in 658us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521440.312750:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 158 00000100:00100000:1.0:1788521440.419668:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.419807:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346115584 00000100:00100000:2.0:1788521440.419817:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346115584 00000100:00100000:2.0:1788521440.419874:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:2.0:1788521440.419885:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+45:11446:x1875400346115584:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521440.419904:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521440.419925:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405a7 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521440.420012:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788521440.420124:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a7 expref: 47 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.420137:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:2.0:1788521440.420139:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521440.420153:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a7 expref: 47 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.420166:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb600, rc 0) 00000100:00100000:2.0:1788521440.420228:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+46:11446:x1875400346115584:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 345us (570us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788521440.420235:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:3.0:1788521440.423151:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521440.423265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346115840 00000100:00100000:0.0:1788521440.423285:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346115840 00000100:00100000:0.0:1788521440.423343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1788521440.423354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+46:11446:x1875400346115840:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521440.423628:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+47:11446:x1875400346115840:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 275us (487us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788521440.423635:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1788521440.507218:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.508294:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346116096 00000100:00100000:2.0:1788521440.508306:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346116096 00000100:00100000:2.0:1788521440.508382:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:2.0:1788521440.508395:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+47:11452:x1875400346116096:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1788521440.508424:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521440.508459:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405ae expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.508579:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.508595:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.508603:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.508636:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.508651:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 48 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521440.508690:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45632300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368137344:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521440.508828:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e006540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521440.515610:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45632300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368137344:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521440.515642:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521440.524592:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.524704:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346116224 00000100:00100000:1.0:1788521440.524715:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346116224 00010000:00010000:1.0:1788521440.524756:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 49 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521440.524829:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:1.0:1788521440.524839:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+49:2345:x1875400346116224:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521440.524853:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521440.524861:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 49 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.524874:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 49 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.524895:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae016e38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405a0 expref: 49 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.524918:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521440.524922:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.524932:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.524939:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.524971:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521440.525021:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+48:2345:x1875400346116224:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 184us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521440.525045:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00010000:00010000:2.0:1788521440.525372:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.525381:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521440.525399:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788521440.525555:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.525570:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 48 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.525578:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.525580:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521440.525583:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00100000:2.0:1788521440.525610:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+48:11452:x1875400346116096:12345-192.168.203.48@tcp:101:bash.0 Request processed in 17219us (18404us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788521440.525618:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:1.0:1788521440.532952:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.534177:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346116480 00000100:00100000:2.0:1788521440.534213:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346116480 00000100:00100000:2.0:1788521440.534290:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:2.0:1788521440.534300:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+48:11452:x1875400346116480:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:2.0:1788521440.534565:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.534593:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.534603:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521440.534658:0:6713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788521440.534680:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfcbcdf4 reply state 00000000d3c9ca25 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521440.534688:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521440.534816:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+51:11452:x1875400346116480:12345-192.168.203.48@tcp:36:bash.0 Request processed in 517us (1873us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788521440.534836:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000020:00080000:2.0:1788521440.534841:0:6713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788521440.537138:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.537158:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.537166:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.537182:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521440.537188:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.537196:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.537237:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521440.537240:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521440.537246:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.537252:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016e62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521440.542915:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.543025:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346116608 00000100:00100000:2.0:1788521440.543037:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346116608 00000100:00100000:2.0:1788521440.543119:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:2.0:1788521440.543132:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+50:11452:x1875400346116608:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1788521440.543160:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521440.543307:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405b5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.543410:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.543457:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.543470:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.543508:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 51 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.543523:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 51 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521440.543538:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45632300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368137472:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521440.543687:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e006a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521440.553476:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.553526:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45632300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368137472:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521440.553584:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346116736 00010000:00010000:1.0:1788521440.553587:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521440.553601:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346116736 00010000:00010000:0.0:1788521440.553662:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 52 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521440.553704:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1788521440.553714:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+52:2346:x1875400346116736:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521440.553728:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521440.553735:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 52 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.553750:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 52 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.553793:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016e54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ae expref: 52 pid: 5832 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.553810:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521440.553815:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.553843:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.553851:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.553887:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521440.554256:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+51:2346:x1875400346116736:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 541us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521440.554265:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00010000:00010000:1.0:1788521440.555997:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.556014:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521440.556059:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788521440.556062:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521440.556085:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.556129:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405b5 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.556147:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405b5 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.556155:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521440.556158:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521440.556162:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea400, rc 0) 00000100:00100000:1.0:1788521440.556238:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+50:11452:x1875400346116608:12345-192.168.203.48@tcp:101:bash.0 Request processed in 13108us (13331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521440.556262:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:1.0:1788521440.564205:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521440.564305:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346116992 00000100:00100000:0.0:1788521440.564321:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346116992 00000100:00100000:0.0:1788521440.564392:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:0.0:1788521440.564405:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+50:11452:x1875400346116992:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1788521440.564673:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+51:11452:x1875400346116992:12345-192.168.203.48@tcp:35:bash.0 Request processed in 270us (488us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788521440.564680:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1788521440.673261:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521440.673551:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346117248 00000100:00100000:0.0:1788521440.673571:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346117248 00000100:00100000:0.0:1788521440.673664:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:0.0:1788521440.673676:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+51:11462:x1875400346117248:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521440.673708:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521440.673734:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae016e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405bc expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521440.673892:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788521440.674012:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae016e77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405bc expref: 53 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.674044:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:0.0:1788521440.674047:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521440.674053:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae016e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405bc expref: 53 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.674069:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f800, rc 0) 00000100:00100000:0.0:1788521440.674130:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+52:11462:x1875400346117248:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 457us (887us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788521440.674139:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:2.0:1788521440.676888:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521440.679759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346117376 00000100:00100000:0.0:1788521440.679791:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346117376 00000100:00100000:0.0:1788521440.679865:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:0.0:1788521440.679878:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+52:11462:x1875400346117376:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1788521440.679952:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.679969:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.679981:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680001:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680008:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680039:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680141:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680149:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680156:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521440.680217:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680231:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680237:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680244:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680249:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521440.680254:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680261:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680274:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:0.0:1788521440.680283:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521440.680289:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680296:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae016e85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680310:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680316:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680321:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680325:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6ec00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521440.680328:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680333:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680340:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521440.680342:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521440.680344:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680349:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ec00/0x53df1cebae016e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680362:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680373:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680377:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680382:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521440.680385:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680390:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680396:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521440.680398:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521440.680400:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521440.680405:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521440.680506:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+52:11462:x1875400346117376:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 630us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521440.680515:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:1.0:1788521440.683858:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.684309:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346117632 00000100:00100000:1.0:1788521440.684324:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346117632 00000100:00100000:1.0:1788521440.684463:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:1.0:1788521440.684477:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+52:11462:x1875400346117632:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521440.684907:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+53:11462:x1875400346117632:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 431us (1065us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788521440.684917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1788521440.723386:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521440.723628:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346117888 00000100:00100000:0.0:1788521440.723643:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346117888 00000100:00100000:0.0:1788521440.723728:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:0.0:1788521440.723743:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+53:11465:x1875400346117888:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521440.723823:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521440.724752:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405c3 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.724978:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725000:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725089:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725171:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725182:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725190:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725372:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016eaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725383:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725391:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016eaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521440.725404:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788521440.725554:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725762:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725867:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725874:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521440.725880:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725889:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725906:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521440.725911:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521440.725916:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725936:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725952:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725959:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725966:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725971:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521440.725975:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725982:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.725991:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521440.725993:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521440.725996:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.726004:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.726189:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e600/0x53df1cebae016e9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405c3 expref: 56 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.726210:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016eaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405c3 expref: 55 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.726225:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521440.726228:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521440.726232:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a800, rc 0) 00000100:00100000:1.0:1788521440.726336:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+55:11465:x1875400346117888:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 2595us (2963us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788521440.726348:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:0.0:1788521440.732512:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521440.732558:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.732633:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346118144 00000100:00100000:1.0:1788521440.732645:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346118144 00000100:00100000:1.0:1788521440.732720:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1788521440.732731:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+55:2347:x1875400346118144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521440.732749:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521440.732821:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016eaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405c3 expref: 55 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.732846:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521440.732852:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521440.732888:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346118016 00000100:00100000:2.0:1788521440.732905:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346118016 00000100:00100000:1.0:1788521440.732922:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+55:2347:x1875400346118144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 191us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521440.732931:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1788521440.733403:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:2.0:1788521440.733417:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+54:11465:x1875400346118016:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521440.733514:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733533:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733544:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733591:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733598:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733605:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733611:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521440.733616:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733623:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733636:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.733639:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521440.733644:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.733650:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521440.733759:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+54:11465:x1875400346118016:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 345us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521440.733768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1788521440.736738:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521440.736886:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346118400 00000100:00100000:3.0:1788521440.736903:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346118400 00000100:00100000:3.0:1788521440.736976:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1788521440.736988:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+54:11465:x1875400346118400:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521440.737338:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+55:11465:x1875400346118400:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 352us (615us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788521440.737347:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1788521440.869245:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.869979:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346118656 00000100:00100000:1.0:1788521440.869993:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346118656 00000100:00100000:2.0:1788521440.870354:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:2.0:1788521440.870368:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a4641aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+55:11483:x1875400346118656:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1788521440.870419:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521440.870460:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405ca expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.870603:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ecb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.870630:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.870643:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ecb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521440.870656:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788521440.870837:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016ec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ca expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.870860:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ecb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ca expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.870870:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.870874:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788521440.870878:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb600, rc 0) 00000100:00100000:2.0:1788521440.871017:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a4641aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+57:11483:x1875400346118656:12345-192.168.203.48@tcp:101:cat.0 Request processed in 652us (1787us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788521440.871025:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 167 00000004:00080000:1.0:1788521440.873086:0:6766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361951308936ns, next at 362951305911ns, rc = 0 00000100:00100000:1.0:1788521440.873242:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368137600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521440.873332:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521440.873762:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368137600 00000100:00100000:1.0:1788521440.873818:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368137600 00000100:00100000:1.0:1788521440.873894:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521440.873906:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368137600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521440.873938:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521440.873997:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75413b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368137600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521440.874419:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368137600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521440.874508:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788521440.911203:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.911455:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346118784 00000100:00100000:1.0:1788521440.911469:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346118784 00000100:00100000:1.0:1788521440.911548:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:1.0:1788521440.911559:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+57:11484:x1875400346118784:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521440.911598:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521440.911633:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ed9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405d1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.911717:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.911734:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.911748:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521440.911832:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788521440.911836:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521440.911860:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.911893:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ed9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d1 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.911927:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d1 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.911939:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521440.911942:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521440.911946:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b400, rc 0) 00000100:00100000:1.0:1788521440.912138:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+58:11484:x1875400346118784:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 580us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521440.912146:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:0.0:1788521440.927033:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.927558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346119168 00000100:00100000:1.0:1788521440.927581:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346119168 00000100:00100000:1.0:1788521440.927830:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1788521440.927844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+58:11484:x1875400346119168:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521440.928267:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+59:11484:x1875400346119168:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 425us (1248us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788521440.928275:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:3.0:1788521440.930540:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.930818:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346119296 00000100:00100000:2.0:1788521440.930832:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346119296 00000100:00100000:2.0:1788521440.930909:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1788521440.930937:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+59:11484:x1875400346119296:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:2.0:1788521440.930958:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788521440.930996:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016e70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405b5 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.931024:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ca expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.931037:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016d7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440576 expref: 57 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.931048:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.931062:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521440.931141:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60ae9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+56:11484:x1875400346119296:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 207us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521440.931149:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521440.934746:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521440.935054:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346119424 00000100:00100000:1.0:1788521440.935067:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346119424 00000100:00100000:1.0:1788521440.935180:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:1.0:1788521440.935192:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+56:11484:x1875400346119424:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:1.0:1788521440.935333:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.935355:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521440.935389:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521440.935663:0:6713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788521440.935807:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+56:11484:x1875400346119424:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 616us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521440.935816:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:1.0:1788521440.975396:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521440.975534:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346119552 00000100:00100000:2.0:1788521440.975548:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346119552 00000100:00100000:2.0:1788521440.975635:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:2.0:1788521440.975649:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+56:11486:x1875400346119552:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521440.975680:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521440.975711:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016eee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405d8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.975851:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.975893:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.975909:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.975928:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.975937:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.975945:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976051:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976061:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976069:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521440.976117:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788521440.976122:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521440.976148:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976162:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976183:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976191:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976199:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976206:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521440.976212:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976221:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976236:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521440.976239:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521440.976245:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976253:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016ef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976267:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976274:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976280:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976291:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521440.976294:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976301:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976309:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a46737900) 00010000:00010000:2.0:1788521440.976312:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521440.976315:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976322:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016efc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976357:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae016eee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976374:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521440.976381:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521440.976383:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788521440.976386:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb400, rc 0) 00000100:00100000:2.0:1788521440.976474:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75410000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+57:11486:x1875400346119552:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 828us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521440.976482:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 170 00010000:00010000:1.0:1788521441.257112:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521441.455334:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521441.455358:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521441.455589:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788521441.455596:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788521441.455715:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a45631880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368137728:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521441.457635:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e006840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521441.478079:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a45631880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368137728:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521441.482651:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521441.482730:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346119680 00000100:00100000:2.0:1788521441.482740:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346119680 00000100:00100000:2.0:1788521441.482830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:2.0:1788521441.482841:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+57:11497:x1875400346119680:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788521441.482874:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788521441.482975:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+57:11497:x1875400346119680:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 136us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521441.482982:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:2.0:1788521441.499149:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521441.499204:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346119808 00000100:00100000:2.0:1788521441.499215:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346119808 00000100:00100000:2.0:1788521441.499271:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:2.0:1788521441.499282:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+57:11497:x1875400346119808:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788521441.499364:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499382:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499395:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499412:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499435:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499454:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499487:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499496:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499514:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521441.499553:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788521441.499557:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521441.499571:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499584:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499591:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499597:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499603:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521441.499608:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499622:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499634:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:2.0:1788521441.499637:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521441.499642:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499648:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016f0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499663:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499668:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499674:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499679:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521441.499682:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499687:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499694:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8c0a46737900) 00010000:00010000:2.0:1788521441.499696:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521441.499698:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499714:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016f11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499730:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499736:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499742:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499747:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521441.499750:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499757:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.499764:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521441.499766:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521441.499769:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.500899:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae016f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.500998:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+57:11497:x1875400346119808:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1714us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521441.501009:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:0.0:1788521441.533125:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521441.533181:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346120064 00000100:00100000:0.0:1788521441.533191:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346120064 00000100:00100000:0.0:1788521441.533256:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:0.0:1788521441.533266:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+57:11497:x1875400346120064:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521441.533286:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521441.533308:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016f1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405df expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533407:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533423:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533436:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521441.533459:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788521441.533561:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533570:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533592:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533599:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521441.533604:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533612:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533624:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:0.0:1788521441.533628:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521441.533633:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533639:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae016f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533681:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016f1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405df expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533691:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:0.0:1788521441.533694:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521441.533698:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae016f1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405df expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.533706:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f000, rc 0) 00000100:00100000:0.0:1788521441.533876:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+58:11497:x1875400346120064:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 610us (758us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788521441.533893:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:0.0:1788521441.555997:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.556109:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346120192 00000100:00100000:1.0:1788521441.556120:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346120192 00000100:00100000:1.0:1788521441.556188:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:1.0:1788521441.556198:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+58:11497:x1875400346120192:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788521441.556235:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788521441.556351:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+58:11497:x1875400346120192:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 154us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521441.556359:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:2.0:1788521441.573220:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.573948:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346120448 00000100:00100000:3.0:1788521441.573960:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346120448 00000100:00100000:3.0:1788521441.574036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:3.0:1788521441.574048:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+58:11497:x1875400346120448:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.574070:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521441.574073:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788521441.574117:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d1 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.574163:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521441.574168:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521441.574184:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae016f34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405e6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788521441.574577:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788521441.574755:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.574769:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.575895:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.575982:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044e00/0x53df1cebae016f34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405e6 expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.576006:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405e6 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.576014:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521441.576017:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521441.576020:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a82045a00, rc 0) 00000100:00100000:3.0:1788521441.576103:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+59:11497:x1875400346120448:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2055us (2891us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788521441.576111:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:2.0:1788521441.585572:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.585638:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346120704 00000100:00100000:3.0:1788521441.585647:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346120704 00000100:00100000:3.0:1788521441.585702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:3.0:1788521441.585711:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+59:11497:x1875400346120704:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.585763:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521441.585817:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82045a00/0x53df1cebae016f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405e6 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585839:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521441.585850:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521441.585875:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585889:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585899:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585912:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585918:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585925:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.585985:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586007:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586014:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586020:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521441.586024:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586031:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586040:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521441.586043:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521441.586046:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586052:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4c00/0x53df1cebae016f49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586063:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586069:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586075:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586079:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c5800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521441.586088:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586095:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586104:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc9fa3c01 (ffff8c0a65ff4700) 00010000:00010000:3.0:1788521441.586106:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521441.586109:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.586114:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c5800/0x53df1cebae016f50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc9fa3c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.586187:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+58:11497:x1875400346120704:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 476us (622us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788521441.586195:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:0.0:1788521441.592320:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.592412:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346120832 00000100:00100000:1.0:1788521441.592428:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346120832 00000100:00100000:1.0:1788521441.592505:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 177 00000100:00100000:1.0:1788521441.592518:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+58:11497:x1875400346120832:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521441.592539:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521441.592565:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016f57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405ed expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.592606:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.592626:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.592638:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.592741:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 60 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.592762:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 59 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.592948:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521441.592952:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521441.592957:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a600, rc 0) 00000100:00100000:1.0:1788521441.593060:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+59:11497:x1875400346120832:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 544us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521441.593069:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 177 00000100:00100000:2.0:1788521441.601673:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.602206:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346121088 00000100:00100000:3.0:1788521441.602217:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346121088 00000100:00100000:3.0:1788521441.602280:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 178 00000100:00100000:3.0:1788521441.602293:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+59:11497:x1875400346121088:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.602387:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.602404:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.602415:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521441.602718:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788521441.602748:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362680973972ns, next at 363680971160ns, rc = 0 00000004:00010000:3.0:1788521441.603320:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cd52b52 reply state 000000001f433f9f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.603331:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521441.603479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+61:11497:x1875400346121088:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1186us (1811us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788521441.603487:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 178 00010000:00010000:1.0:1788521441.606618:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.606638:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.606647:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.606653:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521441.606658:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.606685:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.606708:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521441.606711:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788521441.606716:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.606723:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030400/0x53df1cebae016f65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.607435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.607577:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346121216 00000100:00100000:3.0:1788521441.607587:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346121216 00000100:00100000:3.0:1788521441.608308:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:3.0:1788521441.608320:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+60:11497:x1875400346121216:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.608342:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521441.608361:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405f4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.608422:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.608437:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.608470:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:3.0:1788521441.608474:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521441.608477:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030600, rc 0) 00000100:00100000:3.0:1788521441.608545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e21b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+61:11497:x1875400346121216:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 227us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521441.608553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:0.0:1788521441.622962:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521441.623098:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346121344 00000100:00100000:2.0:1788521441.623109:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346121344 00000100:00100000:2.0:1788521441.623298:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:2.0:1788521441.623309:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346121344:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788521441.623327:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521441.623672:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346121344:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 364us (717us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788521441.623681:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1788521441.626099:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.626250:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346121600 00000100:00100000:3.0:1788521441.626260:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346121600 00000100:00100000:3.0:1788521441.626317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1788521441.626327:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+61:11497:x1875400346121600:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521441.626546:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+62:11497:x1875400346121600:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 219us (457us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788521441.626553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1788521441.635104:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521441.635279:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346121856 00000100:00100000:2.0:1788521441.635289:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346121856 00000100:00100000:2.0:1788521441.635354:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:2.0:1788521441.635365:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+62:11497:x1875400346121856:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788521441.635490:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+62:11497:x1875400346121856:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 126us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521441.635498:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:0.0:1788521441.643978:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.644823:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346121984 00000100:00100000:1.0:1788521441.644838:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346121984 00000100:00100000:1.0:1788521441.644909:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:1.0:1788521441.644918:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+62:11497:x1875400346121984:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521441.644938:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521441.644959:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64405fb expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.645048:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.645062:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.645073:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521441.645135:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521441.645169:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.645389:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405fb expref: 64 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.645410:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405fb expref: 63 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.645420:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521441.645433:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788521441.645437:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521441.645522:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+63:11497:x1875400346121984:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 604us (1552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521441.645528:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:0.0:1788521441.649383:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.649659:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346122112 00000100:00100000:1.0:1788521441.649669:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346122112 00000100:00100000:1.0:1788521441.649729:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1788521441.649740:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346122112:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521441.649756:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521441.649802:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440602 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521441.650099:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aabe1, blocks: 0x1 00010000:00010000:1.0:1788521441.650120:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:1.0:1788521441.650125:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521441.650134:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.650164:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 8 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.650178:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575bc00, rc 0) 00000100:00100000:1.0:1788521441.650241:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346122112:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 502us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521441.650247:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1788521441.667077:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.667259:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346122368 00000100:00100000:3.0:1788521441.667269:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346122368 00000100:00100000:3.0:1788521441.667329:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:3.0:1788521441.667340:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+63:11497:x1875400346122368:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788521441.667460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+63:11497:x1875400346122368:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521441.667468:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:0.0:1788521441.684115:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.684255:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346122496 00000100:00100000:3.0:1788521441.684265:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346122496 00000100:00100000:3.0:1788521441.684343:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1788521441.684354:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:11497:x1875400346122496:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.684373:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521441.684391:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440609 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.684418:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.684427:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521441.684457:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521441.684467:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.684502:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 9 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.684516:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 9 pid: 6693 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.684531:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368137856:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521441.684638:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4593bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521441.697767:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521441.697846:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346122624 00000100:00100000:0.0:1788521441.697856:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346122624 00010000:00010000:0.0:1788521441.697896:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 10 pid: 6693 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.697935:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1788521441.697944:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+10:2345:x1875400346122624:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521441.697958:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521441.697978:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 10 pid: 6693 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.697993:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 10 pid: 6693 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.698021:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521441.698032:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521441.698044:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.698055:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.698096:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 10 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.698112:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875400368137984:192.168.203.48@tcp:105: 00000100:00100000:0.0:1788521441.698367:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc840 going to sleep for 11 seconds 00010000:00010000:3.0:1788521441.698861:0:6690:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae016f81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440602 expref: 10 pid: 6693 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.698878:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368137856:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521441.698903:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 9 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.698916:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031800, rc 0) 00000100:00100000:3.0:1788521441.698955:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+9:11497:x1875400346122496:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 14603us (14853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521441.698962:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1788521441.702624:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5818:1875400368137984:192.168.203.48@tcp:105: 00010000:00010000:3.0:1788521441.702657:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521441.702872:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346122624:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 4927us (5114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521441.702884:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1788521441.714265:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521441.715148:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346122752 00000100:00100000:0.0:1788521441.715159:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346122752 00002000:00100000:0.0:1788521441.715219:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c0a6dfb7b80 x1875400346122752/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:442/0 lens 504/0 e 0 to 0 dl 1788521452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521441.715231:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6dfb7b80 with x1875400346122752 ext(0->8) 00002000:00010000:0.0:1788521441.715237:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a6dfb7b80 00000100:00100000:0.0:1788521441.715279:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1788521441.715290:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346122752:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788521441.717641:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:2345:x1875400346122752:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 2343us (3376us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788521441.717654:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00002000:00100000:0.0:1788521441.717666:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8c0a6dfb7b80 x1875400346122752/t4294967314(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:442/0 lens 504/448 e 0 to 0 dl 1788521452 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521441.717696:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6dfb7b80 with x1875400346122752 ext(0->8) 00002000:00010000:0.0:1788521441.717703:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a6dfb7b80 00000100:00100000:0.0:1788521441.720232:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.720328:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346122880 00000100:00100000:3.0:1788521441.720339:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346122880 00000100:00100000:3.0:1788521441.720397:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 183 00000100:00100000:3.0:1788521441.720407:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+63:11497:x1875400346122880:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788521441.791621:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+63:11497:x1875400346122880:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 71203us (71386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521441.791635:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 183 00000001:00080000:1.0:1788521441.792393:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000004:00080000:1.0:1788521441.792417:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1788521441.792457:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788521441.792500:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a457c1900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788521441.792506:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a50557700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a457c1240 00000020:00080000:1.0:1788521441.792510:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a50557e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a75923400 00000001:00080000:1.0:1788521441.792542:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788521441.792550:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1788521441.792611:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368138112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788521441.792678:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521441.792816:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368138112 00000100:00100000:2.0:1788521441.792824:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368138112 00000100:00100000:2.0:1788521441.792884:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521441.792894:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875400368138112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788521441.792934:0:8219:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788521441.792972:0:8219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9aabde, atime: 0x6a9aabde, ctime: 0x6a9aabde, blocks: 0x1 00010000:00010000:2.0:1788521441.792982:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.793002:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=362s v=(0 0) 00000020:00080000:0.0:1788521441.793005:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:2.0:1788521441.793007:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521441.793016:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.793034:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.793044:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.793052:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.793071:0:8219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788521441.793323:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788521441.793492:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788521441.793693:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6dfb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368138240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788521441.793736:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75412680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368138112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 841us (1056us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788521441.793741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521441.793752:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788521441.793812:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368138240 00000100:00100000:2.0:1788521441.793817:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368138240 00000100:00100000:2.0:1788521441.793854:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788521441.793860:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368138240:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1788521441.793915:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a458e0a80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788521441.793923:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368138112:0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1788521441.794002:0:8219:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788521441.794007:0:8219:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788521441 00002000:00010000:2.0:1788521441.794009:0:8219:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788521441.794011:0:8219:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788521441 -> 1788521441 00002000:00010000:2.0:1788521441.794014:0:8219:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788521441.794062:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1875400368138240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (323us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788521441.794070:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:2.0:1788521441.794092:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521441.794101:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.794112:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521441.794118:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.794130:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.794154:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.794163:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073d9f5b9/0x53df1cebae016f8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521441.795483:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a6dfb7480/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788521441.795500:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6dfb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368138240:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788521441.795728:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521441.795731:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521441.795744:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521441.795755:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521441.798284:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.798519:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346123008 00000100:00100000:1.0:1788521441.798536:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346123008 00000100:00100000:1.0:1788521441.798595:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:1.0:1788521441.798606:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:2346:x1875400346123008:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1788521441.863581:0:12467:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521441.863591:0:12467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521441.863638:0:12467:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788521441.863644:0:12467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788521441.879537:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:2346:x1875400346123008:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 80920us (81250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521441.879551:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000001:00080000:3.0:1788521441.886280:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1788521441.886303:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788521441.886587:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.886673:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346123264 00000100:00100000:3.0:1788521441.886681:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346123264 00000100:00100000:3.0:1788521441.886765:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:3.0:1788521441.886795:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a48f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+18:11497:x1875400346123264:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.886852:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521441.886882:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405fb expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.887017:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:3.0:1788521441.887024:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521441.887055:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.887069:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.887078:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521441.887307:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064691c09 reply state 00000000fab47f72 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.887328:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521441.888094:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a48f5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:11497:x1875400346123264:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1316us (1507us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788521441.888103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:3.0:1788521441.892890:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1788521441.892972:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.892985:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.892992:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.892997:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346123392 00010000:00010000:1.0:1788521441.893000:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030a00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521441.893005:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.893008:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346123392 00010000:00010000:1.0:1788521441.893013:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.893028:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521441.893031:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521441.893035:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.893041:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030a00/0x53df1cebae016f96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.893059:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:2.0:1788521441.893069:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2348:x1875400346123392:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788521441.893324:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788521441.893328:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788521441 -> 1788521440 00002000:00010000:2.0:1788521441.893330:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788521438 00002000:00010000:2.0:1788521441.893332:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788521441 -> 1788521440 00002000:00010000:2.0:1788521441.893335:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788521441.901533:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2348:x1875400346123392:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 8455us (8645us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788521441.901546:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1788521441.914063:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.914150:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346123648 00000100:00100000:1.0:1788521441.914186:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346123648 00000100:00100000:1.0:1788521441.914250:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:1.0:1788521441.914261:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+18:11497:x1875400346123648:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788521441.914352:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.914378:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.914646:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.914688:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 18 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.914703:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 18 pid: 6713 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521441.914718:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368138368:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521441.914839:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521441.919437:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368138368:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521441.919483:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.922258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521441.922462:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346123776 00000100:00100000:2.0:1788521441.922471:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346123776 00010000:00010000:2.0:1788521441.922509:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 19 pid: 6713 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.922549:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:2.0:1788521441.922567:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+19:2346:x1875400346123776:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521441.922580:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521441.922586:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 19 pid: 6713 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.922598:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 19 pid: 6713 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.922630:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae016f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405ed expref: 19 pid: 6713 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.922643:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:2.0:1788521441.922647:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.922656:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.922662:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.922688:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521441.922736:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:2346:x1875400346123776:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 179us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521441.922744:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00010000:00010000:1.0:1788521441.927185:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927204:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927251:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927259:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927266:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927273:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521441.927278:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927287:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927308:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521441.927311:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788521441.927317:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.927323:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae016f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521441.927413:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+17:11497:x1875400346123648:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 13150us (13356us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788521441.927423:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:0.0:1788521441.937189:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.937263:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346123904 00000100:00100000:3.0:1788521441.937274:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346123904 00000100:00100000:3.0:1788521441.937327:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1788521441.937335:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+8:2347:x1875400346123904:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788521441.937375:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.937396:0:8219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.937404:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788521441.937409:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521441.937414:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.937465:0:8219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.937479:0:8219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 8 pid: 6690 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.937494:0:8219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368138496:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521441.937578:0:8219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a46245a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521441.942170:0:8219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368138496:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521441.942201:0:8219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.948133:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.949709:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346124032 00000100:00100000:3.0:1788521441.949725:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346124032 00010000:00010000:3.0:1788521441.949815:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 9 pid: 6690 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.949854:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:3.0:1788521441.949864:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+9:2346:x1875400346124032:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521441.949879:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521441.949983:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 9 pid: 6690 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.949999:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 9 pid: 6690 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.950037:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c32d9e42/0x53df1cebae016f88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440609 expref: 9 pid: 6690 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.950054:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521441.950059:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521441.950065:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.950076:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521441.950116:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521441.950481:0:8219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950493:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950520:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950529:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950536:0:8219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521441.950537:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346124032:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 673us (2412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521441.950546:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00010000:00010000:0.0:1788521441.950554:0:8219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030c00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521441.950569:0:8219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950579:0:8219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950601:0:8219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.950609:0:8219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000516f4661/0x53df1cebae016fa4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.950662:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2347:x1875400346123904:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 13326us (13482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521441.950671:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1788521441.953977:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521441.954128:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346124288 00000100:00100000:1.0:1788521441.954138:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346124288 00000100:00100000:1.0:1788521441.954207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:1.0:1788521441.954225:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+17:11497:x1875400346124288:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788521441.955021:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955044:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955056:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955711:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955726:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955736:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955835:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.955853:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 18 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521441.955868:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368138624:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521441.956072:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521441.959158:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521441.959488:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346124416 00000100:00100000:3.0:1788521441.959499:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346124416 00010000:00010000:3.0:1788521441.959544:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 19 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.959645:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368138624:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521441.959676:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.960129:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1788521441.960142:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:2346:x1875400346124416:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521441.960398:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521441.960408:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 19 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.960423:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 19 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.960457:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030600/0x53df1cebae016f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405f4 expref: 19 pid: 5834 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.960480:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:2.0:1788521441.960486:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.960494:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.960502:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.960536:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521441.960943:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.960959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521441.961180:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788521441.961342:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788521441.961389:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788521441.961494:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875400368138752:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521441.961569:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521441.961621:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521441.961758:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+21:2346:x1875400346124416:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1616us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521441.961786:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:3.0:1788521441.962018:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368138752 00000100:00100000:3.0:1788521441.962025:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368138752 00000100:00100000:3.0:1788521441.962082:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521441.962092:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875400368138752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788521441.962178:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875400368138752:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521441.962194:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788521441.963263:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788521441.963275:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a6dfb7480, transno 4294967315 00000100:00100000:2.0:1788521441.963299:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875400368138752:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788521441.964225:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788521441.964300:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875400368138880:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788521441.964361:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521441.964393:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6e006240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521441.965242:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368138880 00000100:00100000:3.0:1788521441.965251:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368138880 00000100:00100000:3.0:1788521441.965303:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521441.965313:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1875400368138880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521441.965754:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5833:1875400368138880:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788521441.965846:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965858:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965867:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965874:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521441.965879:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965887:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965903:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521441.965906:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521441.965910:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965924:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae016fb2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965951:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965958:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965964:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965968:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521441.965971:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965977:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965985:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:1.0:1788521441.965987:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521441.965990:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.965996:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae016ee7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.966014:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.966027:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.966041:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.966072:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.966086:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 21 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521441.966099:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368139008:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521441.966169:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521441.966225:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1875400368138880:12345-0@lo:1000:mdt00_001.0 Request processed in 247us (1197us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788521441.966235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521441.969970:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521441.970089:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368139008:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521441.970334:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.970421:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346124544 00000100:00100000:0.0:1788521441.970430:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346124544 00010000:00010000:0.0:1788521441.970479:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 22 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521441.970529:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:0.0:1788521441.970538:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+22:2346:x1875400346124544:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521441.970552:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521441.970752:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 22 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.970765:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 22 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.970841:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae016f03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64405d8 expref: 22 pid: 5833 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.970859:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:0.0:1788521441.970863:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.970875:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.970883:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.970907:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521441.970990:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:2346:x1875400346124544:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 452us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521441.970998:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00010000:00010000:2.0:1788521441.971067:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971084:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971097:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971103:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971111:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971117:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521441.971121:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971130:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971140:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521441.971143:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521441.971146:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971152:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae016fb9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971163:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971169:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971180:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971186:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521441.971189:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971196:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971204:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1ce00) 00010000:00010000:2.0:1788521441.971207:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521441.971210:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521441.971216:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae016fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521441.971425:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:11497:x1875400346124288:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 17203us (17457us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1788521441.971433:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 186 00000020:00080000:2.0:1788521441.971448:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788521441.971619:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521441.971629:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521441.972214:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788521441.972224:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521441.978100:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521441.978191:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346124800 00000100:00100000:0.0:1788521441.978201:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346124800 00000100:00100000:0.0:1788521441.978262:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1788521441.978272:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a44050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+20:11497:x1875400346124800:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788521441.979140:0:11971:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788521441.979239:0:11971:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788521441.979285:0:11971:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.979301:0:11971:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.979313:0:11971:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.979322:0:11971:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.979328:0:11971:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.979335:0:11971:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.979388:0:11971:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521441.979502:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a44050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:11497:x1875400346124800:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1229us (1409us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788521441.979510:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000020:00080000:0.0:1788521441.979522:0:11971:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521441.980883:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521441.980895:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.980905:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521441.980909:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.980919:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.980934:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8c0a4fa31300) 00010000:00010000:1.0:1788521441.980937:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521441.980942:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521441.980959:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae016fc0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11971 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521441.981051:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521441.981054:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521441.981055:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521442.280967:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521442.410151:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368139392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410230:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521442.410303:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788521442.410311:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521442.410314:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368139392 00000100:00100000:2.0:1788521442.410324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368139392 00000100:00100000:0.0:1788521442.410342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521442.410367:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368139264:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521442.410410:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368139776:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410449:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521442.410474:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368139136 00000100:00100000:0.0:1788521442.410478:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368139136 00000100:00100000:2.0:1788521442.410506:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368139776 00000100:00100000:2.0:1788521442.410512:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368139776 00000100:00100000:0.0:1788521442.410513:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788521442.410523:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368139136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521442.410547:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788521442.410552:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788521442.410560:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368139392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410605:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1875400368139136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521442.410613:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788521442.410624:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368139392:12345-0@lo:400:kworker.0 Request processed in 63us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521442.410632:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788521442.410640:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368139264 00000100:00100000:0.0:1788521442.410644:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368139264 00000100:00100000:2.0:1788521442.410653:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788521442.410662:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410675:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788521442.410684:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368139264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521442.410695:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368139776:12345-0@lo:400:kworker.0 Request processed in 34us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521442.410702:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1788521442.410724:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521442.410737:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368139264:12345-0@lo:400:kworker.0 Request processed in 54us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521442.410755:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788521442.410823:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368139136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521442.410833:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368139264:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410843:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368139776:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.410853:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368139392:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.412239:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368139648:0@lo:400:kworker.0 00000100:00100000:0.0:1788521442.412307:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521442.412317:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368139520:0@lo:400:kworker.0 00000100:00100000:1.0:1788521442.412358:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521442.412614:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368139648 00000100:00100000:3.0:1788521442.412622:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368139648 00000100:00100000:3.0:1788521442.412669:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788521442.412679:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875400368139648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521442.412738:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1875400368139648:12345-0@lo:400:kworker.0 Request processed in 61us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521442.412745:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788521442.412803:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368139648:0@lo:400:kworker.0 00000100:00100000:2.0:1788521442.413724:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368139520 00000100:00100000:2.0:1788521442.413736:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368139520 00000100:00100000:2.0:1788521442.413831:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788521442.413841:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368139520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788521442.414639:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521442.414823:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368139520:12345-0@lo:400:kworker.0 Request processed in 980us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521442.414846:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788521442.415803:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368139520:0@lo:400:kworker.0 00000001:00080000:0.0:1788521442.544753:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:0.0:1788521442.544769:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788521442.544811:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:3.0:1788521443.308834:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521443.950173:0:12520:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521443.950183:0:12520:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521443.950221:0:12520:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788521443.950226:0:12520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521444.174498:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521444.174834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346125056 00000100:00100000:2.0:1788521444.174844:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346125056 00000100:00100000:2.0:1788521444.174907:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:2.0:1788521444.174917:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+22:11517:x1875400346125056:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521444.174940:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521444.174961:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016fc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440610 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521444.175050:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016fce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521444.175082:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521444.175094:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016fce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521444.175107:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788521444.175226:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae016fc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440610 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521444.175242:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016fce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440610 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521444.175250:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521444.175252:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788521444.175256:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb200, rc 0) 00000100:00080000:0.0:1788521444.175404:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521444.175697:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+24:11517:x1875400346125056:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 780us (1206us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788521444.175705:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:0.0:1788521444.211117:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.211195:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346125184 00000100:00100000:3.0:1788521444.211208:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346125184 00000100:00100000:3.0:1788521444.211272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:3.0:1788521444.211283:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:11517:x1875400346125184:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1788521444.211500:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.211518:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.211530:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.211556:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.211565:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.211572:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212396:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212408:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212416:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521444.212479:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212494:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212510:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212517:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212523:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.212528:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212536:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212909:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521444.212912:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521444.212917:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212924:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae016fdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212943:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212948:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212953:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212957:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.212967:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212973:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212980:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521444.212983:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521444.212985:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.212990:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae016fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213006:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213012:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213018:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213023:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.213026:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213032:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213039:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a65ff4700) 00010000:00010000:3.0:1788521444.213041:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521444.213049:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.213055:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae016fea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.213172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:11517:x1875400346125184:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1884us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.213183:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:1.0:1788521444.292418:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.292480:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346125440 00000100:00100000:1.0:1788521444.292492:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346125440 00000100:00100000:1.0:1788521444.292596:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:1.0:1788521444.292609:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+24:11520:x1875400346125440:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521444.292635:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.292667:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016ff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440617 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.292758:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.292817:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.292830:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.292846:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.292853:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.292876:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293172:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293182:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293189:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521444.293200:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788521444.293312:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293321:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293327:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293332:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.293337:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293345:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293357:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521444.293360:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.293372:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293378:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae016ff8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293390:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293396:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293402:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293407:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.293411:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293416:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293438:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1cf00) 00010000:00010000:1.0:1788521444.293441:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.293444:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293450:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae016fff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293497:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae016ff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 27 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293524:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 26 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.293533:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.293536:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521444.293538:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a000, rc 0) 00000100:00100000:1.0:1788521444.293632:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+26:11520:x1875400346125440:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1025us (1226us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788521444.293641:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:2.0:1788521444.302010:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.302104:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346125568 00000100:00100000:3.0:1788521444.302117:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346125568 00000100:00100000:3.0:1788521444.302187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:3.0:1788521444.302198:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+26:11520:x1875400346125568:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1788521444.302274:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302293:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302317:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302345:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302352:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302359:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302364:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.302383:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302393:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302405:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:3.0:1788521444.302408:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521444.302413:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.302419:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.302534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+26:11520:x1875400346125568:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 336us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.304530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:0.0:1788521444.308288:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.308729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346125824 00000100:00100000:3.0:1788521444.308743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346125824 00000100:00100000:3.0:1788521444.308843:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:3.0:1788521444.308855:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+26:11520:x1875400346125824:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521444.309150:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+27:11520:x1875400346125824:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 295us (873us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788521444.309159:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00010000:00010000:2.0:1788521444.328916:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521444.361988:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.362114:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126080 00000100:00100000:1.0:1788521444.362123:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126080 00000100:00100000:1.0:1788521444.362182:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:1.0:1788521444.362192:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+27:11044:x1875400346126080:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521444.362218:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.362239:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01701b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644061e expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.362331:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.362346:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 28 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.362355:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.362386:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 28 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.362415:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 28 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.362442:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368139904:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521444.362546:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521444.365841:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368139904:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521444.365875:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521444.367872:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.368017:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126208 00000100:00100000:3.0:1788521444.368028:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126208 00010000:00010000:3.0:1788521444.368075:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 29 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.368115:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1788521444.368141:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+29:2345:x1875400346126208:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521444.368157:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521444.368164:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 29 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.368178:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 29 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.368200:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae017006 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440617 expref: 29 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.368217:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:3.0:1788521444.368222:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.368232:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.368239:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.368272:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521444.368331:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+28:2345:x1875400346126208:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 191us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.368338:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00010000:00010000:1.0:1788521444.369110:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.369120:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521444.369141:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788521444.369293:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae01701b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 29 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.369311:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 28 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.369319:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.369322:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521444.369325:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b000, rc 0) 00000100:00100000:1.0:1788521444.369381:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+28:11044:x1875400346126080:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7191us (7405us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788521444.369407:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:2.0:1788521444.375008:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.375094:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126464 00000100:00100000:1.0:1788521444.375104:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126464 00000100:00100000:1.0:1788521444.375164:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:1.0:1788521444.375174:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+28:11044:x1875400346126464:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:1.0:1788521444.375467:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.375486:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.375502:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521444.375572:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788521444.376794:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4c5709f reply state 00000000468282db transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.376811:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788521444.376910:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788521444.377043:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+32:11044:x1875400346126464:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1864us (2040us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788521444.377052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 192 00000020:00080000:1.0:1788521444.377058:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788521444.379749:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.379817:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.379850:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.379858:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.379863:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.379872:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.379890:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.379893:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.379899:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.379906:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a800/0x53df1cebae017030 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521444.381085:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.381724:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126592 00000100:00100000:1.0:1788521444.381736:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126592 00000100:00100000:1.0:1788521444.381823:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:1.0:1788521444.381834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+31:11044:x1875400346126592:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521444.381861:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.381885:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae017037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440625 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.381946:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae017037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440625 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.381979:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae017037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440625 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.382003:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.382006:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521444.382009:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b200, rc 0) 00000100:00100000:1.0:1788521444.382419:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+32:11044:x1875400346126592:12345-192.168.203.48@tcp:101:bash.0 Request processed in 584us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521444.382437:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:0.0:1788521444.386647:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.387283:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126720 00000100:00100000:1.0:1788521444.387294:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126720 00000100:00100000:1.0:1788521444.387404:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:1.0:1788521444.387414:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:11044:x1875400346126720:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521444.387440:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.387460:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644062c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521444.387486:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9aabe0, atime: 0x6a9aabde, ctime: 0x6a9aabe0, blocks: 0xb 00010000:00010000:1.0:1788521444.387509:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1788521444.387514:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521444.387523:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.387552:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.387803:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a800, rc 0) 00000100:00100000:1.0:1788521444.387869:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:11044:x1875400346126720:12345-192.168.203.48@tcp:101:bash.0 Request processed in 456us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521444.387876:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00080000:0.0:1788521444.388958:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521444.392731:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.392877:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126848 00000100:00100000:1.0:1788521444.392887:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126848 00002000:00010000:1.0:1788521444.392929:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788521444.392934:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7ab60a80 with x1875400346126848 ext(0->18446744073709551615) 00002000:00010000:1.0:1788521444.392945:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7ab60a80. 00000100:00100000:1.0:1788521444.392978:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1788521444.392988:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346126848:12345-192.168.203.48@tcp:10:bash.0 00002000:00010000:1.0:1788521444.393263:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788521444.393267:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788521440 -> 1788521444 00002000:00010000:1.0:1788521444.393269:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788521438 -> 1788521438 00002000:00010000:1.0:1788521444.393271:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788521440 -> 1788521444 00002000:00010000:1.0:1788521444.393273:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788521444.393436:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:2345:x1875400346126848:12345-192.168.203.48@tcp:10:bash.0 Request processed in 447us (857us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788521444.393444:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00002000:00010000:1.0:1788521444.393448:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788521444.393450:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a7ab60a80 with x1875400346126848 ext(0->18446744073709551615) 00002000:00010000:1.0:1788521444.393455:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a7ab60a80. 00000100:00100000:2.0:1788521444.464486:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521444.464533:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521444.464588:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.464848:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346127232 00000100:00100000:3.0:1788521444.464858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346127232 00000100:00100000:3.0:1788521444.464927:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:3.0:1788521444.464937:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346127232:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521444.465017:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2347:x1875400346127232:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.465024:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:0.0:1788521444.465165:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346126976 00000100:00100000:0.0:1788521444.465170:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346126976 00000100:00100000:0.0:1788521444.465207:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 297 00000100:00100000:0.0:1788521444.465215:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346126976:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521444.465241:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46236850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346126976:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521444.465257:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 297 00000100:00100000:1.0:1788521444.466495:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346127104 00000100:00100000:1.0:1788521444.466509:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346127104 00000100:00100000:1.0:1788521444.466618:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1788521444.466628:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346127104:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521444.466699:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346127104:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 73us (2116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521444.466707:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00080000:2.0:1788521444.467288:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788521444.467294:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521444.494088:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.494334:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346127360 00000100:00100000:1.0:1788521444.494346:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346127360 00000100:00100000:1.0:1788521444.494414:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:1.0:1788521444.494440:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+32:11534:x1875400346127360:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1788521444.494524:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494555:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494569:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494595:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494602:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494608:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494919:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494939:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.494946:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521444.494994:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495006:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495012:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495019:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495026:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.495030:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495038:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495051:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521444.495054:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.495059:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495066:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495086:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495093:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495100:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495106:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.495109:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495115:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495122:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521444.495125:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.495128:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495134:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae01704c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495148:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495155:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495161:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495172:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.495175:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495181:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495189:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.495191:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.495194:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.495199:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.495278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+32:11534:x1875400346127360:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 853us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521444.495287:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:2.0:1788521444.548860:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.549056:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346127616 00000100:00100000:3.0:1788521444.549067:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346127616 00000100:00100000:3.0:1788521444.549170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:3.0:1788521444.549181:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+32:11537:x1875400346127616:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521444.549200:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521444.549221:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae01705a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440633 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549288:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549313:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549325:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549341:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549349:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549356:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549662:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031600/0x53df1cebae01706f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549679:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031600/0x53df1cebae01706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.549688:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031600/0x53df1cebae01706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521444.549700:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788521444.550120:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550129:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550136:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550142:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.550146:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550154:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550169:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521444.550172:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521444.550177:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550184:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae017061 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550202:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550216:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550222:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550227:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.550230:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550237:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550245:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a65ff4700) 00010000:00010000:3.0:1788521444.550248:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521444.550250:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550256:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae017068 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550324:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae01705a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440633 expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550341:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031600/0x53df1cebae01706f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440633 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.550349:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:3.0:1788521444.550351:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788521444.550363:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031600, rc 0) 00000100:00100000:3.0:1788521444.551024:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+34:11537:x1875400346127616:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1838us (2168us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788521444.551036:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:0.0:1788521444.555463:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.556159:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346127744 00000100:00100000:1.0:1788521444.556169:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346127744 00000100:00100000:1.0:1788521444.556273:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:1.0:1788521444.556285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+34:11537:x1875400346127744:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1788521444.556449:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.556467:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 34 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.556477:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.556534:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 34 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.556558:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 34 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.556579:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368140032:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521444.556736:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521444.561002:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521444.561087:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346128000 00000100:00100000:0.0:1788521444.561100:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346128000 00000100:00100000:0.0:1788521444.561164:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:0.0:1788521444.561175:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+35:5586:x1875400346128000:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788521444.561626:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+36:5586:x1875400346128000:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 452us (634us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788521444.561634:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:2.0:1788521444.563955:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.564046:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346128128 00000100:00100000:3.0:1788521444.564059:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346128128 00010000:00010000:3.0:1788521444.564105:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 36 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.564140:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:3.0:1788521444.564149:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+36:2345:x1875400346128128:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521444.564170:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521444.564177:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 36 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.564189:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 36 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.564213:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:3.0:1788521444.564218:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.564227:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.564235:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.564253:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521444.564398:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60aeac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+36:2345:x1875400346128128:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 249us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.564405:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00010000:00010000:1.0:1788521444.565941:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017022 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644061e expref: 35 pid: 6713 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.565962:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368140032:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521444.565986:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.565996:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566001:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566033:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566040:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566047:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566070:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.566074:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566082:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566097:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.566100:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521444.566105:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.566111:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01707d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.566230:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+34:11537:x1875400346127744:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 9946us (10776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521444.566239:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:2.0:1788521444.569266:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521444.569442:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346128384 00000100:00100000:0.0:1788521444.569454:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346128384 00000100:00100000:0.0:1788521444.569751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1788521444.569763:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+34:11537:x1875400346128384:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521444.570151:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+35:11537:x1875400346128384:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 389us (895us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788521444.570160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:2.0:1788521444.668954:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.669058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346128640 00000100:00100000:1.0:1788521444.669067:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346128640 00000100:00100000:1.0:1788521444.669126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 197 00000100:00100000:1.0:1788521444.669136:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+35:11548:x1875400346128640:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:1.0:1788521444.669159:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.669179:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017084 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644063a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669252:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669287:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669309:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669325:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669339:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669623:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669633:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669640:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521444.669649:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788521444.669742:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669749:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669755:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669767:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.669817:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669826:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669839:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521444.669842:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.669846:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669852:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae01708b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669864:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669870:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669876:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669880:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.669883:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669888:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669906:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521444.669909:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.669912:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669919:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae017092 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669967:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017084 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644063a expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669981:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644063a expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.669988:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.669990:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521444.669992:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a400, rc 0) 00000100:00100000:1.0:1788521444.670066:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+37:11548:x1875400346128640:12345-192.168.203.48@tcp:101:cat.0 Request processed in 931us (1122us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788521444.670075:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 197 00000100:00100000:2.0:1788521444.676610:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.676810:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346128896 00000100:00100000:3.0:1788521444.676820:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346128896 00000100:00100000:3.0:1788521444.676928:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:3.0:1788521444.676939:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+37:11548:x1875400346128896:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:3.0:1788521444.677169:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+38:11548:x1875400346128896:12345-192.168.203.48@tcp:35:cat.0 Request processed in 229us (565us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788521444.677177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:2.0:1788521444.699515:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.699732:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346129152 00000100:00100000:3.0:1788521444.699743:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346129152 00000100:00100000:3.0:1788521444.699831:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00100000:3.0:1788521444.699842:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+38:11549:x1875400346129152:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:3.0:1788521444.699903:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788521444.699931:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae017099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644063a expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.699955:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031600/0x53df1cebae01706f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440633 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.699971:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae017037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440625 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.699980:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:3.0:1788521444.699991:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521444.700010:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700041:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700051:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700066:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700072:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700079:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700460:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700470:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.700477:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521444.701227:0:6713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788521444.701238:0:6713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365779464278ns, next at 366779461275ns, rc = 0 00010000:00010000:3.0:1788521444.701470:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.701487:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.701507:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.701516:0:6713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.701521:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.701527:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.703939:0:6713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521444.703986:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.703997:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704004:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704009:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.704013:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704020:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704034:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:3.0:1788521444.704037:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788521444.704061:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704067:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae0170b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704094:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704100:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704105:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704109:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521444.704111:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704117:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704124:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521444.704127:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521444.704129:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.704134:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0170a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521444.704143:0:6713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f90e2fb2 reply state 000000006f5dcddc transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.704166:0:6713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521444.704373:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+37:11549:x1875400346129152:12345-192.168.203.48@tcp:36:rm.0 Request processed in 4460us (4795us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788521444.704383:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 198 00010000:00010000:0.0:1788521444.704463:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521444.704470:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521444.704476:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521444.704479:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521444.704486:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521444.704506:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8c0a65ff4000) 00010000:00010000:0.0:1788521444.704508:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788521444.704512:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521444.704517:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae0170bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521444.704534:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521444.704536:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521444.704549:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521444.721123:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.721141:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.721149:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.721178:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.721183:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.721192:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.721211:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a65ff4700) 00010000:00010000:1.0:1788521444.721215:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.721219:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.721225:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031c00/0x53df1cebae0170ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521444.775700:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.775823:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346129408 00000100:00100000:1.0:1788521444.775837:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346129408 00000100:00100000:1.0:1788521444.775903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:1.0:1788521444.775914:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+36:11555:x1875400346129408:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521444.775939:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.775961:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0170c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440641 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776080:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776096:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776127:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776142:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776149:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776155:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521444.776814:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788521444.776985:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.776996:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777003:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777035:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777041:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777047:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777052:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.777062:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777070:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777081:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521444.777083:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.777088:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777094:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521444.777107:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3956a68 reply state 00000000af9b2a04 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.777115:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788521444.777143:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0170c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777156:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.777163:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521444.777166:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521444.777168:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b400, rc 0) 00000100:00100000:1.0:1788521444.777246:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+39:11555:x1875400346129408:12345-192.168.203.48@tcp:101:bash.0 Request processed in 1334us (1555us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788521444.777253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 199 00010000:00010000:1.0:1788521444.779987:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.780003:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.780010:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.780016:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521444.780020:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.780028:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.780043:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1cd00) 00010000:00010000:1.0:1788521444.780046:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521444.780051:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.780056:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0170d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521444.783977:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521444.784210:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346129536 00000100:00100000:3.0:1788521444.784220:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346129536 00000100:00100000:3.0:1788521444.784278:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:3.0:1788521444.784288:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+5:2348:x1875400346129536:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1788521444.784315:0:8219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521444.784336:0:8219:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440648 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788521444.784360:0:8219:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788521444.784380:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1788521444.784384:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521444.784393:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 6 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.784411:0:8219:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 6 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.784435:0:8219:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030000, rc 0) 00000100:00100000:3.0:1788521444.784492:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2348:x1875400346129536:12345-192.168.203.48@tcp:101:bash.0 Request processed in 206us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.784499:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1788521444.789594:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.789691:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346129664 00000100:00100000:1.0:1788521444.789703:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346129664 00000100:00100000:1.0:1788521444.789766:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:1.0:1788521444.789816:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+6:11555:x1875400346129664:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521444.789835:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521444.789857:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644064f expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.789912:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.789921:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521444.789925:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521444.789930:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.789967:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.789981:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521444.789996:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875400368140160:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521444.790077:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521444.795118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521444.795260:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6690:1875400368140160:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521444.795401:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521444.795434:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b000, rc 0) 00000100:00100000:1.0:1788521444.795491:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:11555:x1875400346129664:12345-192.168.203.48@tcp:101:bash.0 Request processed in 5716us (5927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521444.795500:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1788521444.796184:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346129792 00000100:00100000:3.0:1788521444.796191:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346129792 00010000:00010000:3.0:1788521444.796236:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.796289:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:3.0:1788521444.796381:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346129792:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521444.796396:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521444.796488:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.796503:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.796524:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df96705e/0x53df1cebae0170e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440648 expref: 7 pid: 8219 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.796544:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521444.796548:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521444.796556:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.796567:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521444.797121:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521444.797156:0:5820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875400368140288:192.168.203.48@tcp:105: 00000100:00100000:3.0:1788521444.797238:0:5820:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521444.802016:0:5820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1875400368140288:192.168.203.48@tcp:105: 00010000:00010000:3.0:1788521444.802046:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521444.802105:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346129792:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 5806us (7002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521444.802116:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1788521444.805255:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521444.805445:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346130048 00000100:00100000:0.0:1788521444.805457:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346130048 00000100:00100000:0.0:1788521444.805524:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1788521444.805543:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+38:11555:x1875400346130048:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1788521444.806046:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+39:11555:x1875400346130048:12345-192.168.203.48@tcp:35:bash.0 Request processed in 513us (809us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788521444.806054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:2.0:1788521445.037853:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.037967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346130176 00000100:00100000:1.0:1788521445.037982:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346130176 00000100:00100000:1.0:1788521445.038044:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:1.0:1788521445.038054:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+39:11572:x1875400346130176:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521445.038080:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521445.038106:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0170f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440656 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.038180:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.038500:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.038516:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521445.038554:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788521445.038557:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521445.038576:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.038601:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0170f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440656 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.038620:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440656 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.038629:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521445.038632:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521445.038656:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575aa00, rc 0) 00000100:00100000:1.0:1788521445.038721:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+40:11572:x1875400346130176:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 668us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.038729:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:2.0:1788521445.045900:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.046029:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346130432 00000100:00100000:1.0:1788521445.046053:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346130432 00000100:00100000:1.0:1788521445.046121:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:1.0:1788521445.046133:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+40:11572:x1875400346130432:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521445.046158:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521445.046184:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644065d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.046301:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.046315:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.046326:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521445.046337:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788521445.046498:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644065d expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.046519:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644065d expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.046529:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521445.046739:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521445.046744:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575bc00, rc 0) 00000100:00100000:1.0:1788521445.046862:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+42:11572:x1875400346130432:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 731us (983us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788521445.046869:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:2.0:1788521445.067520:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521445.067604:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521445.067742:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346130688 00000100:00100000:3.0:1788521445.067751:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346130688 00000100:00100000:3.0:1788521445.067851:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:3.0:1788521445.067862:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+42:11572:x1875400346130688:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521445.067900:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521445.067936:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440664 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.068076:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae01711e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.068097:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae01711e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.068112:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae01711e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521445.068127:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788521445.068277:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440664 expref: 45 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.068309:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae01711e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440664 expref: 44 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.068318:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:3.0:1788521445.068322:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788521445.068325:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031800, rc 0) 00000100:00100000:3.0:1788521445.068397:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+44:11572:x1875400346130688:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 537us (893us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788521445.068405:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:1.0:1788521445.072477:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346130816 00000100:00100000:1.0:1788521445.072497:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346130816 00000100:00100000:1.0:1788521445.073520:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1788521445.073552:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+44:2345:x1875400346130816:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521445.073570:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521445.073597:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644065d expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.073617:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521445.073622:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521445.073693:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+43:2345:x1875400346130816:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 161us (6088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.073700:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:2.0:1788521445.078656:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521445.078740:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346130944 00000100:00100000:3.0:1788521445.078752:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346130944 00000100:00100000:3.0:1788521445.078840:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1788521445.078851:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+6:2345:x1875400346130944:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:3.0:1788521445.078931:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.078953:0:8219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.078963:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788521445.078968:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521445.078972:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.079009:0:8219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 6 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.079044:0:8219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 6 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521445.079061:0:8219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8219:1875400368140416:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521445.079166:0:8219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521445.090235:0:8219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8219:1875400368140416:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521445.090276:0:8219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521445.093859:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.094447:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346131072 00000100:00100000:0.0:1788521445.094458:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346131072 00002000:00100000:0.0:1788521445.094519:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c0a6e3d4a80 x1875400346131072/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:446/0 lens 504/0 e 0 to 0 dl 1788521456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521445.094531:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6e3d4a80 with x1875400346131072 ext(0->8) 00010000:00010000:0.0:1788521445.094608:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 7 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.094627:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 7 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521445.094651:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a6e3d4a80 00000100:00100000:0.0:1788521445.094737:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1788521445.094747:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346131072:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:0.0:1788521445.096431:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+9:2346:x1875400346131072:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 1664us (2560us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788521445.096448:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00002000:00100000:0.0:1788521445.096462:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8c0a6e3d4a80 x1875400346131072/t4294967308(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:446/0 lens 504/448 e 0 to 0 dl 1788521456 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788521445.096474:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6e3d4a80 with x1875400346131072 ext(0->8) 00010000:00010000:0.0:1788521445.096485:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 9 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.096508:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 9 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521445.096517:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8c0a6e3d4a80 00000100:00100000:2.0:1788521445.109647:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.109980:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346131200 00000100:00100000:0.0:1788521445.109993:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346131200 00010000:00010000:0.0:1788521445.110045:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 9 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521445.110093:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:0.0:1788521445.110104:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+9:2345:x1875400346131200:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521445.110143:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788521445.110168:0:5819:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788521445.110172:0:5819:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788521444 00002000:00010000:0.0:1788521445.110174:0:5819:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788521444 00002000:00010000:0.0:1788521445.110177:0:5819:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788521444 00010000:00010000:0.0:1788521445.110185:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 9 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.110200:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 9 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.110231:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0170ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644064f expref: 9 pid: 6690 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.110538:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521445.110543:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521445.110551:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.110563:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.110611:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521445.110721:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346131200:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 618us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.110730:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00010000:00010000:1.0:1788521445.112270:0:8219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112291:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112344:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112375:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112382:0:8219:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112389:0:8219:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521445.112394:0:8219:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112402:0:8219:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112433:0:8219:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.112441:0:8219:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093706b3b/0x53df1cebae01712c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521445.112568:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346130944:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 33713us (33916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.112577:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1788521445.120751:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.120947:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346131456 00000100:00100000:0.0:1788521445.120959:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346131456 00000100:00100000:0.0:1788521445.122084:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:0.0:1788521445.122105:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a45850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+43:11572:x1875400346131456:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:0.0:1788521445.122185:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae01711e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440664 expref: 43 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521445.122475:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788521445.122520:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788521445.122907:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788521445.122971:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.122989:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.123000:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.123042:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.123059:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 47 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521445.123076:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab61180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875400368140544:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521445.123187:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521445.139571:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab61180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5836:1875400368140544:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521445.139624:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521445.140153:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.140499:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346131584 00000100:00100000:0.0:1788521445.140508:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346131584 00010000:00010000:0.0:1788521445.140545:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 48 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521445.140587:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:0.0:1788521445.140597:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+48:2346:x1875400346131584:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521445.140611:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521445.140618:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 48 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.140631:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 48 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.140653:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae0170d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440641 expref: 48 pid: 5832 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.140669:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:0.0:1788521445.140674:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.140684:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.140691:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.140820:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521445.140884:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+47:2346:x1875400346131584:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 282us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.140892:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00010000:00010000:3.0:1788521445.144538:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.144559:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788521445.144705:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788521445.145587:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788521445.145742:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368140672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788521445.147102:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521445.147215:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da000 going to sleep for 11 seconds 00000100:00100000:2.0:1788521445.154850:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368140672 00000100:00100000:2.0:1788521445.154944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368140672 00000100:00100000:2.0:1788521445.155106:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521445.155120:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875400368140672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788521445.155301:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5836:x1875400368140672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 184us (8206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521445.155328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521445.156549:0:5836:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788521445.156562:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788521445.156583:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a458e0a80, transno 4294967307 00000100:00100000:1.0:1788521445.156626:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368140672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788521445.157222:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788521445.157328:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368140800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788521445.157398:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521445.157444:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521445.157929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368140800 00000100:00100000:3.0:1788521445.157937:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368140800 00000100:00100000:3.0:1788521445.157991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521445.158002:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875400368140800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788521445.158276:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875400368140800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 275us (876us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788521445.158284:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521445.159271:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5836:1875400368140800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788521445.159362:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788521445.159413:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.159436:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.159444:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.159451:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521445.159456:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.159465:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.159482:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521445.159485:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788521445.159490:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.159497:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017133 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521445.159707:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788521445.159843:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788521445.159855:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366238080369ns, next at 367238078003ns, rc = 0 00000001:00080000:1.0:1788521445.159861:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788521445.160217:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521445.160221:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788521445.160230:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031800/0x53df1cebae01711e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440664 expref: 51 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521445.160505:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a45850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+50:11572:x1875400346131456:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 38408us (39762us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788521445.160517:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000020:00080000:1.0:1788521445.160523:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788521445.164299:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521445.177880:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.178139:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346131712 00000100:00100000:0.0:1788521445.178150:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346131712 00000100:00100000:0.0:1788521445.178221:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:0.0:1788521445.178232:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+50:11572:x1875400346131712:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521445.178259:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521445.178283:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae01713a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644066b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.178347:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae01713a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644066b expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.178364:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae01713a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644066b expref: 51 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.178384:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.178387:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521445.178391:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f800, rc 0) 00000100:00100000:0.0:1788521445.178462:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+51:11572:x1875400346131712:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 232us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.178469:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:2.0:1788521445.188555:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.188717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346131968 00000100:00100000:0.0:1788521445.188743:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346131968 00000100:00100000:0.0:1788521445.188903:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1788521445.188914:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+51:11572:x1875400346131968:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521445.189160:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+52:11572:x1875400346131968:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 247us (620us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788521445.189168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:2.0:1788521445.315276:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521445.315542:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346132096 00000100:00100000:3.0:1788521445.315554:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346132096 00000100:00100000:3.0:1788521445.315620:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 204 00000100:00100000:3.0:1788521445.315631:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+52:11582:x1875400346132096:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1788521445.315725:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.315741:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.315753:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.315769:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.315804:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.315810:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316018:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316027:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316050:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521445.316093:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316104:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316110:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316117:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316124:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521445.316128:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316134:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316145:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:3.0:1788521445.316148:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521445.316153:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316159:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316177:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316188:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316195:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316199:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521445.316203:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316208:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316215:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a65ff4800) 00010000:00010000:3.0:1788521445.316218:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521445.316221:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316226:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316241:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316246:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316252:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316256:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521445.316264:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316271:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316279:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:3.0:1788521445.316281:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521445.316284:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.316290:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae01714f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521445.318189:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+52:11582:x1875400346132096:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 2553us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521445.318207:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 204 00010000:00010000:2.0:1788521445.353312:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521445.363059:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.363343:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346132352 00000100:00100000:1.0:1788521445.363353:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346132352 00000100:00100000:1.0:1788521445.363471:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:1.0:1788521445.363483:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+52:11585:x1875400346132352:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521445.363504:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521445.363525:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440672 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363623:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363638:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363652:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363693:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363702:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363708:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363844:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae01716b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363865:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae01716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363873:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae01716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521445.363882:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788521445.363983:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363992:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.363998:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364004:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521445.364008:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364025:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364037:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521445.364039:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521445.364043:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364050:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae01715d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364064:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364069:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364074:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364079:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521445.364082:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364088:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364095:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521445.364097:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521445.364100:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364119:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364162:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440672 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364176:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae01716b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440672 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.364184:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521445.364186:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521445.364189:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a600, rc 0) 00000100:00100000:1.0:1788521445.364261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+54:11585:x1875400346132352:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 781us (1211us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788521445.364269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:2.0:1788521445.368493:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.369717:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346132480 00000100:00100000:0.0:1788521445.369732:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346132480 00000100:00100000:0.0:1788521445.369899:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:0.0:1788521445.369915:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+54:11585:x1875400346132480:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1788521445.370010:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370035:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370053:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370090:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370100:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370109:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370117:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521445.370124:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370178:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370195:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.370199:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521445.370205:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.370215:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521445.370325:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+54:11585:x1875400346132480:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 416us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.370333:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:2.0:1788521445.378126:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.378369:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346132736 00000100:00100000:1.0:1788521445.378379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346132736 00000100:00100000:1.0:1788521445.378480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:1.0:1788521445.378498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+54:11585:x1875400346132736:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1788521445.384372:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+55:11585:x1875400346132736:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 5870us (6250us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788521445.384383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:3.0:1788521445.529742:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.529824:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346132992 00000100:00100000:1.0:1788521445.529834:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346132992 00000100:00100000:1.0:1788521445.529893:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 207 00000100:00100000:1.0:1788521445.529902:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+55:11595:x1875400346132992:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521445.529944:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521445.529947:0:6713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788521445.529975:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0170fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440656 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.529996:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521445.530000:0:6713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521445.530014:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017180 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440679 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.530131:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.530144:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.530154:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521445.530165:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788521445.530282:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae017180 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440679 expref: 57 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.530296:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440679 expref: 56 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.530304:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521445.530307:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521445.530309:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521445.530374:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+56:11595:x1875400346132992:12345-192.168.203.48@tcp:101:bash.0 Request processed in 472us (642us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788521445.530381:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 207 00000100:00100000:2.0:1788521445.543173:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.543470:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346133248 00000100:00100000:0.0:1788521445.543485:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346133248 00000100:00100000:0.0:1788521445.543928:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:0.0:1788521445.543949:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+56:11595:x1875400346133248:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1788521445.544015:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788521445.544055:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440679 expref: 56 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.544088:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a600/0x53df1cebae01716b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440672 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.544104:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.544112:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521445.544391:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.544411:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.544442:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521445.544528:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788521445.544587:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eff09269 reply state 00000000835c8a6c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521445.544597:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521445.546529:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+57:11595:x1875400346133248:12345-192.168.203.48@tcp:36:bash.0 Request processed in 2580us (3388us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788521445.546550:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 208 00000020:00080000:0.0:1788521445.546559:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521445.553435:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.553454:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.553461:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.553467:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521445.553472:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.553482:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.553499:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521445.553502:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521445.553507:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.553514:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e800/0x53df1cebae017195 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521445.554192:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.554671:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346133376 00000100:00100000:1.0:1788521445.554690:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346133376 00000100:00100000:1.0:1788521445.554750:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:1.0:1788521445.554760:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+56:11595:x1875400346133376:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521445.554842:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521445.555068:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01719c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440680 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.555154:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.555168:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.555180:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521445.555209:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788521445.555213:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521445.555233:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.555259:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01719c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 58 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.555275:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 57 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.555282:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521445.555285:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521445.555288:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575aa00, rc 0) 00000100:00100000:1.0:1788521445.555353:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+57:11595:x1875400346133376:12345-192.168.203.48@tcp:101:bash.0 Request processed in 595us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.555360:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:2.0:1788521445.564980:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.565147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346133632 00000100:00100000:0.0:1788521445.565162:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346133632 00000100:00100000:0.0:1788521445.565255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:0.0:1788521445.565271:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+57:11595:x1875400346133632:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1788521445.565625:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+58:11595:x1875400346133632:12345-192.168.203.48@tcp:35:bash.0 Request processed in 356us (655us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788521445.565639:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:3.0:1788521445.691286:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.691454:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346133760 00000100:00100000:1.0:1788521445.691464:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346133760 00000100:00100000:1.0:1788521445.691531:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:1.0:1788521445.691549:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+58:11601:x1875400346133760:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521445.691573:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521445.691597:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440687 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.691663:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0171b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.691685:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0171b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.691697:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0171b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521445.691731:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788521445.691735:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521445.691752:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0171b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.691833:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440687 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.692304:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0171b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440687 expref: 59 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.692314:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521445.692317:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521445.692338:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b600, rc 0) 00000100:00100000:1.0:1788521445.692436:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346133760:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 896us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.692444:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:2.0:1788521445.697376:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.701155:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346133888 00000100:00100000:0.0:1788521445.701173:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346133888 00000100:00100000:0.0:1788521445.701242:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:0.0:1788521445.701252:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346133888:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521445.701272:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521445.701309:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644068e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701374:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701389:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701400:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701428:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701436:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701443:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701540:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701549:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701557:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521445.701890:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788521445.701895:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521445.701915:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701936:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701945:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701952:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701957:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701963:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521445.701966:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701973:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701984:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:0.0:1788521445.701987:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521445.701991:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.701996:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae0171bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702008:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702013:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702025:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702030:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521445.702032:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702038:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702046:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521445.702049:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521445.702052:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702057:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702088:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644068e expref: 61 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702101:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644068e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.702108:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.702110:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521445.702112:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6ee00, rc 0) 00000100:00100000:0.0:1788521445.702327:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+60:11601:x1875400346133888:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1075us (4959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.702345:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:2.0:1788521445.707842:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521445.707889:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.707982:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346134016 00000100:00100000:0.0:1788521445.707993:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346134016 00000100:00100000:0.0:1788521445.708055:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1788521445.708065:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:2345:x1875400346134016:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521445.708081:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521445.708111:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ee00/0x53df1cebae0171cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644068e expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.708131:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.708136:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521445.708188:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+59:2345:x1875400346134016:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.708195:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1788521445.709318:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346134272 00000100:00100000:3.0:1788521445.709328:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346134272 00000100:00100000:3.0:1788521445.709380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:3.0:1788521445.709389:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346134272:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521445.709407:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521445.709435:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae0171d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440695 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.709530:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.709585:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 60 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.709594:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.709627:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 60 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.709641:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 60 pid: 6713 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521445.709654:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368140928:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521445.709738:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521445.717746:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368140928:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521445.718014:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521445.725045:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.730083:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346134400 00000100:00100000:0.0:1788521445.730107:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346134400 00010000:00010000:0.0:1788521445.730351:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 61 pid: 6713 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521445.730397:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1788521445.730408:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+61:2347:x1875400346134400:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521445.730435:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521445.730442:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 61 pid: 6713 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.730456:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 61 pid: 6713 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.730506:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575aa00/0x53df1cebae0171a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440680 expref: 61 pid: 6713 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.730523:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.730528:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.730636:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.730645:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.730723:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521445.730820:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+60:2347:x1875400346134400:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 413us (5782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.730828:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00010000:00010000:3.0:1788521445.734018:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.734035:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521445.734061:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788521445.734241:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae0171d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.734293:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521445.734302:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:3.0:1788521445.734305:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788521445.734308:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031000, rc 0) 00000100:00100000:3.0:1788521445.734382:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+60:11601:x1875400346134272:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 24994us (26491us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788521445.734391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:2.0:1788521445.739950:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521445.750833:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346134656 00000100:00100000:0.0:1788521445.750849:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346134656 00000100:00100000:0.0:1788521445.751063:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1788521445.751075:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60aea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:11601:x1875400346134656:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:0.0:1788521445.751110:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521445.751170:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f800/0x53df1cebae01713a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644066b expref: 60 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521445.751222:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521445.751239:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521445.751319:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60aea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346134656:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 245us (11381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521445.751327:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1788521445.757172:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521445.757316:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346134784 00000100:00100000:1.0:1788521445.757325:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346134784 00000100:00100000:1.0:1788521445.757428:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:1.0:1788521445.757439:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346134784:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:1.0:1788521445.757548:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.757567:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521445.757578:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521445.757824:0:6713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788521445.757902:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346134784:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 464us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.757911:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:0.0:1788521445.774810:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521445.774915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346134912 00000100:00100000:2.0:1788521445.774925:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346134912 00000100:00100000:2.0:1788521445.774983:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:2.0:1788521445.774993:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+59:11601:x1875400346134912:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521445.775013:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521445.775038:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644069c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521445.775100:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521445.775112:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521445.775159:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521445.775174:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521445.775190:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:2.0:1788521445.775193:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521445.775197:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521445.775205:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb600, rc 0) 00000100:00100000:2.0:1788521445.775271:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:11601:x1875400346134912:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 278us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521445.775278:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:2.0:1788521445.994359:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788521445.994388:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368141056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521445.994490:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521445.995233:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368141056 00000100:00100000:1.0:1788521445.995244:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368141056 00000100:00100000:1.0:1788521445.995311:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788521445.995863:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368141056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521445.995896:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521445.996028:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368141056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 709us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521445.996035:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788521446.002231:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368141056:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788521446.057057:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521446.057066:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521446.057131:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788521446.057141:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521446.057398:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368141184:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788521446.057653:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521446.067475:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.067621:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346135040 00000100:00100000:1.0:1788521446.067632:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346135040 00000100:00100000:1.0:1788521446.067715:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:1.0:1788521446.067728:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346135040:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788521446.067771:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788521446.067924:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346135040:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 199us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.067933:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00080000:0.0:1788521446.068209:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521446.069557:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358b100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368141184:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788521446.077322:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.078032:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346135168 00000100:00100000:0.0:1788521446.078044:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346135168 00000100:00100000:0.0:1788521446.078109:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:0.0:1788521446.078120:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:11602:x1875400346135168:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521446.078209:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078228:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078244:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078270:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078280:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078317:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078349:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078357:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521446.078400:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788521446.078406:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521446.078431:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078444:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078452:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078460:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078466:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521446.078471:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078480:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078493:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:0.0:1788521446.078497:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521446.078503:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078521:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0171f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078547:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078553:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078559:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078563:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521446.078566:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.078580:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079375:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521446.079378:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521446.079383:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079390:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0171fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079421:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079428:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079446:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079451:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521446.079454:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079464:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079472:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521446.079475:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521446.079477:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.079483:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f400/0x53df1cebae017205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.080059:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+60:11602:x1875400346135168:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1932us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521446.080071:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:1.0:1788521446.092502:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521446.092604:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346135424 00000100:00100000:2.0:1788521446.092613:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346135424 00000100:00100000:2.0:1788521446.092672:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:2.0:1788521446.092683:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+60:11602:x1875400346135424:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521446.092702:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521446.092724:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae01720c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406a3 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.092892:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.092909:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.092921:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521446.092931:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788521446.093028:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093037:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093044:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093049:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521446.093054:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093061:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093073:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:2.0:1788521446.093076:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788521446.093081:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093098:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae017213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093147:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae01720c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406a3 expref: 62 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093157:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:2.0:1788521446.093160:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521446.093163:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae01720c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406a3 expref: 62 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.093173:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb400, rc 0) 00000100:00100000:2.0:1788521446.093241:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346135424:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 559us (748us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788521446.093249:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:2.0:1788521446.110373:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.110562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346135552 00000100:00100000:3.0:1788521446.110573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346135552 00000100:00100000:3.0:1788521446.110636:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:3.0:1788521446.110649:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346135552:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521446.110692:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521446.110848:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346135552:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 200us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521446.110877:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:3.0:1788521446.117024:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.117156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346135808 00000100:00100000:1.0:1788521446.117176:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346135808 00000100:00100000:1.0:1788521446.117368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:1.0:1788521446.117380:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346135808:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521446.117401:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521446.117405:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788521446.117448:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae0171b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440687 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.117470:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521446.117478:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521446.117494:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017221 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406aa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521446.118026:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788521446.118239:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae017228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.118255:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae017228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.118637:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae017228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.118710:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017221 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406aa expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.118727:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae017228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406aa expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.118737:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:1.0:1788521446.118740:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521446.118744:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b400, rc 0) 00000100:00100000:1.0:1788521446.118952:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+62:11602:x1875400346135808:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1575us (1945us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788521446.118961:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:1.0:1788521446.128120:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.128211:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346136064 00000100:00100000:0.0:1788521446.128228:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346136064 00000100:00100000:0.0:1788521446.128386:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:0.0:1788521446.128398:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+62:11602:x1875400346136064:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521446.128480:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521446.128510:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b400/0x53df1cebae017228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406aa expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129137:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a42b1c700) 00010000:00010000:0.0:1788521446.129148:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521446.129178:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129189:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129199:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129215:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129221:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129227:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129299:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129306:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129313:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129319:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521446.129324:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129341:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129352:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:0.0:1788521446.129356:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521446.129361:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129367:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017236 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129380:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129386:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129392:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129397:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521446.129400:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129405:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129422:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x679a320b (ffff8c0a4fa31f00) 00010000:00010000:0.0:1788521446.129424:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521446.129426:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.129442:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae01723d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x679a320b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.132651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346136064:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1167us (1462us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521446.132669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:0.0:1788521446.137956:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521446.138062:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346136192 00000100:00100000:2.0:1788521446.138074:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346136192 00000100:00100000:2.0:1788521446.138143:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:2.0:1788521446.138155:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+61:11602:x1875400346136192:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521446.138177:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521446.138203:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406b1 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.138253:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.138287:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.138299:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.138397:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 63 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.138433:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 62 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.138443:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:2.0:1788521446.138446:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521446.138450:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb000, rc 0) 00000100:00100000:2.0:1788521446.138517:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+62:11602:x1875400346136192:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 364us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521446.138524:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:3.0:1788521446.144382:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.144530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346136448 00000100:00100000:1.0:1788521446.144544:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346136448 00000100:00100000:1.0:1788521446.144623:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:1.0:1788521446.144637:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+62:11602:x1875400346136448:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788521446.144914:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.144937:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.144951:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521446.145622:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788521446.145632:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367223858329ns, next at 368223855949ns, rc = 0 00000004:00010000:1.0:1788521446.146092:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000324b7405 reply state 00000000f66c40cb transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.146105:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521446.146271:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+64:11602:x1875400346136448:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1632us (1899us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788521446.146283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 222 00010000:00010000:1.0:1788521446.149333:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.149356:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.149365:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.149373:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521446.149380:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.149391:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.149445:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:1.0:1788521446.149450:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788521446.149456:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.149484:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a200/0x53df1cebae017252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521446.150336:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521446.152424:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346136576 00000100:00100000:2.0:1788521446.152441:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346136576 00000100:00100000:2.0:1788521446.152518:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 223 00000100:00100000:2.0:1788521446.152529:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+63:11602:x1875400346136576:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521446.152556:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521446.152577:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406b8 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.152639:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 64 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.152675:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 64 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.152697:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:2.0:1788521446.152700:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788521446.152703:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81beb400, rc 0) 00000100:00100000:2.0:1788521446.152770:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+64:11602:x1875400346136576:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 243us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521446.152808:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 223 00000100:00100000:0.0:1788521446.157329:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.157712:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346136704 00000100:00100000:1.0:1788521446.157731:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346136704 00000100:00100000:1.0:1788521446.157841:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1788521446.157853:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:2346:x1875400346136704:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788521446.158219:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521446.158229:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+10:2346:x1875400346136704:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 369us (908us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788521446.158240:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:0.0:1788521446.163858:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.163954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346136960 00000100:00100000:1.0:1788521446.163977:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346136960 00000100:00100000:1.0:1788521446.164084:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:1.0:1788521446.164096:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+64:11602:x1875400346136960:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521446.164408:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+65:11602:x1875400346136960:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 314us (567us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788521446.164425:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1788521446.168605:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.168962:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346137216 00000100:00100000:1.0:1788521446.168975:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346137216 00000100:00100000:1.0:1788521446.169050:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:1.0:1788521446.169062:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+65:11602:x1875400346137216:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521446.169221:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+65:11602:x1875400346137216:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 161us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.169229:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:0.0:1788521446.173441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521446.173916:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346137344 00000100:00100000:2.0:1788521446.174060:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346137344 00000100:00100000:2.0:1788521446.174253:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 225 00000100:00100000:2.0:1788521446.174273:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+65:11602:x1875400346137344:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521446.174294:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521446.174318:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae017260 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406bf expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.174393:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae017267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.174419:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae017267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.174433:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae017267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521446.174478:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521446.174514:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae017267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.174554:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea600/0x53df1cebae017260 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406bf expref: 67 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.174582:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae017267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406bf expref: 66 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.174591:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:2.0:1788521446.174594:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788521446.174598:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea400, rc 0) 00000100:00100000:2.0:1788521446.174663:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+66:11602:x1875400346137344:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 401us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521446.174669:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 225 00000100:00100000:3.0:1788521446.178851:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.179484:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346137472 00000100:00100000:1.0:1788521446.179499:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346137472 00000100:00100000:1.0:1788521446.179589:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:1.0:1788521446.179600:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+10:2345:x1875400346137472:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521446.179618:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521446.179642:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406c6 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521446.179672:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aabe5, blocks: 0x1 00010000:00010000:1.0:1788521446.179695:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788521446.179700:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521446.179711:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.179733:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.179750:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521446.179983:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0ec78abe-db90-4086-b379-6c867e47751e+11:2345:x1875400346137472:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 384us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.179991:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:0.0:1788521446.187474:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.188007:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346137728 00000100:00100000:1.0:1788521446.188018:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346137728 00000100:00100000:1.0:1788521446.188109:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:1.0:1788521446.188120:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+66:11602:x1875400346137728:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788521446.188268:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+66:11602:x1875400346137728:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 141us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.188293:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:0.0:1788521446.191957:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.192156:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346137856 00000100:00100000:3.0:1788521446.192165:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346137856 00000100:00100000:3.0:1788521446.192224:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:3.0:1788521446.192233:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+11:11602:x1875400346137856:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521446.192251:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521446.192377:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406cd expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.192421:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.192430:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521446.192434:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521446.192439:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.192474:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.192487:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521446.192521:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368141312:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521446.192667:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaf300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521446.197402:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.198118:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6690:1875400368141312:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521446.198155:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 12 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.198180:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030200, rc 0) 00000100:00100000:3.0:1788521446.198234:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+12:11602:x1875400346137856:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 6001us (6286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521446.198243:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1788521446.199987:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346137984 00000100:00100000:1.0:1788521446.200000:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346137984 00010000:00010000:1.0:1788521446.200045:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.200129:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:1.0:1788521446.200140:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+12:2346:x1875400346137984:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521446.200159:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521446.200188:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.200203:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.200227:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003074c61e/0x53df1cebae01726e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406c6 expref: 12 pid: 6692 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.200244:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521446.200249:0:8520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521446.200267:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.200280:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.200343:0:8520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 11 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.200357:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8520:1875400368141440:192.168.203.48@tcp:105: 00000100:00100000:1.0:1788521446.200453:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521446.205722:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8520:1875400368141440:192.168.203.48@tcp:105: 00010000:00010000:1.0:1788521446.205750:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521446.205839:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+11:2346:x1875400346137984:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 5699us (8445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.205850:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:3.0:1788521446.207620:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521446.207771:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346138112 00000100:00100000:2.0:1788521446.207817:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346138112 00002000:00100000:2.0:1788521446.207872:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8c094358b800 x1875400346138112/t0(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:447/0 lens 504/0 e 0 to 0 dl 1788521457 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521446.207883:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c094358b800 with x1875400346138112 ext(0->12) 00002000:00010000:2.0:1788521446.207889:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c094358b800 00000100:00100000:2.0:1788521446.207931:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1788521446.207943:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+11:2346:x1875400346138112:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788521446.208670:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0ec78abe-db90-4086-b379-6c867e47751e+13:2346:x1875400346138112:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 727us (1055us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788521446.208679:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00002000:00100000:2.0:1788521446.208689:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8c094358b800 x1875400346138112/t4294967320(0) o4->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:447/0 lens 504/448 e 0 to 0 dl 1788521457 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788521446.208704:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c094358b800 with x1875400346138112 ext(0->12) 00002000:00010000:2.0:1788521446.208708:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c094358b800 00000100:00100000:2.0:1788521446.213873:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.213964:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346138240 00000100:00100000:0.0:1788521446.213973:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346138240 00000100:00100000:0.0:1788521446.214039:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 227 00000100:00100000:0.0:1788521446.214049:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+66:11602:x1875400346138240:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788521446.258544:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000020:00080000:1.0:1788521446.258604:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788521446.258622:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788521446.258632:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:1.0:1788521446.258656:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788521446.258672:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a44d2f600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788521446.258678:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a44876700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a44d2fcc0 00000020:00080000:1.0:1788521446.258682:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a44876400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a58270000 00000020:00080000:1.0:1788521446.258720:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a6e006180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788521446.258723:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a4586ac00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a6e006480 00000020:00080000:1.0:1788521446.258725:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a4586a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a7f223400 00000004:00080000:1.0:1788521446.258741:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1788521446.258761:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788521446.259148:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788521446.259351:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368141568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788521446.259852:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521446.259911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521446.260028:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368141568 00000100:00100000:2.0:1788521446.260038:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368141568 00000100:00100000:2.0:1788521446.260103:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788521446.260113:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1875400368141568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788521446.260142:0:8219:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788521446.260174:0:8219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.260196:0:8219:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.260205:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788521446.260209:0:8219:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788521446.260214:0:8219:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.260242:0:8219:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.260256:0:8219:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 12 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.260299:0:8219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e3d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368141952:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521446.260360:0:8219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4482f780 going to sleep for 11 seconds 00000100:00080000:2.0:1788521446.260373:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521446.260468:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368141696:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788521446.260500:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521446.260807:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368141824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788521446.260838:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521446.260914:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+20:11602:x1875400346138240:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 46865us (47048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521446.260935:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 227 00000100:00100000:3.0:1788521446.266221:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.266355:0:8219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e3d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8219:1875400368141952:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521446.266386:0:8219:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.268459:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368141696 00000100:00100000:2.0:1788521446.268479:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368141696 00000100:00100000:2.0:1788521446.268992:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368141824 00000100:00100000:2.0:1788521446.268998:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368141824 00000100:00100000:2.0:1788521446.269028:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521446.269040:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368141696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788521446.270238:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00002000:00010000:2.0:1788521446.270361:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788521446.270366:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788521446 00002000:00010000:2.0:1788521446.270368:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788521446.270371:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788521445 -> 1788521446 00002000:00010000:2.0:1788521446.270374:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788521446.270454:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788521446.270465:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788521446.270711:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346138496 00000100:00100000:1.0:1788521446.270719:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346138496 00000100:00100000:1.0:1788521446.270844:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521446.270854:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3300:x1875400368141824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788521446.270881:0:12534:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788521446.270911:0:12534:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9aabe4, atime: 0x6a9aabe4, ctime: 0x6a9aabe4, blocks: 0x1 00010000:00010000:1.0:1788521446.270918:0:12534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521446.271070:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346138368 00000100:00100000:3.0:1788521446.271075:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346138368 00010000:00010000:3.0:1788521446.271098:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521446.271127:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:3.0:1788521446.271141:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+14:2346:x1875400346138368:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521446.271151:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521446.271156:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.271169:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.271190:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1c3d335/0x53df1cebae01703e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644062c expref: 14 pid: 6692 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.271209:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521446.271214:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521446.271220:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.271232:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.271422:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3302:x1875400368141696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2372us (10908us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788521446.271431:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788521446.271455:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:2.0:1788521446.271463:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+13:2346:x1875400346138496:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788521446.271797:0:12534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788521446.271802:0:12534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521446.271807:0:12534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.271820:0:12534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.271848:0:12534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.271858:0:12534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788521446.271910:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fb7b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788521446.272071:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 5 min 3 max 116 00000100:00100000:0.0:1788521446.272082:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_005' 00010000:00010000:3.0:1788521446.272255:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521446.272484:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+13:2346:x1875400346138368:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1341us (6275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521446.272493:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00010000:00010000:0.0:1788521446.272709:0:12534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521446.272723:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521446.272730:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.272752:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521446.272757:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.272767:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.272797:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.272805:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003074c61e/0x53df1cebae017283 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.272824:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521446.272826:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521446.272828:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521446.273043:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368141696:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788521446.273195:0:8219:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.273218:0:8219:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.273228:0:8219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.273236:0:8219:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.273250:0:8219:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788521446.276896:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368141824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6035us (16049us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788521446.276910:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788521446.278320:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3302:x1875400368141568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18146us (18406us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788521446.278336:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788521446.278383:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521446.278392:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.278405:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521446.278419:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.278431:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.278454:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.278475:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007576fb3a/0x53df1cebae01727c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.278500:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521446.278502:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521446.278504:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788521446.279948:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fb6680/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788521446.279961:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368141824:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788521446.279999:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fb4000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788521446.280003:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368141568:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788521446.334173:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1788521446.334196:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1788521446.334201:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:2.0:1788521446.334403:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346138496:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 62930us (64161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521446.334424:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1788521446.338533:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.338636:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346138752 00000100:00100000:0.0:1788521446.338648:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346138752 00000100:00100000:0.0:1788521446.338714:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:0.0:1788521446.338724:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:11602:x1875400346138752:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521446.338822:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521446.338856:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea400/0x53df1cebae017267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406bf expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.338897:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:0.0:1788521446.338904:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521446.338952:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.338967:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.338979:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788521446.339334:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047e553c7 reply state 000000006e47895d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.339344:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521446.339452:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+21:11602:x1875400346138752:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 728us (928us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788521446.339460:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:3.0:1788521446.345868:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:0.0:1788521446.346110:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.346123:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.346130:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.346136:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521446.346141:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.346148:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346138880 00000100:00100000:1.0:1788521446.346159:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346138880 00010000:00010000:0.0:1788521446.346166:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.346183:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:0.0:1788521446.346186:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521446.346191:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.346197:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01728a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.346221:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1788521446.346231:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346138880:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788521446.346527:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788521446.346531:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788521446 -> 1788521445 00002000:00010000:1.0:1788521446.346534:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788521444 00002000:00010000:1.0:1788521446.346537:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788521446 -> 1788521445 00002000:00010000:1.0:1788521446.346539:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788521446.346658:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfe9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346138880:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 426us (798us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788521446.346677:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1788521446.354963:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.355244:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346139136 00000100:00100000:1.0:1788521446.355256:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346139136 00000100:00100000:1.0:1788521446.355398:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:1.0:1788521446.355420:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+20:11602:x1875400346139136:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788521446.355504:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.355522:0:6713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.355533:0:6713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.355573:0:6713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.355588:0:6713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 20 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.355605:0:6713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368142080:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521446.355713:0:6713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521446.359376:0:6713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6713:1875400368142080:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521446.359416:0:6713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.362329:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.363043:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346139264 00000100:00100000:0.0:1788521446.363056:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346139264 00010000:00010000:0.0:1788521446.363101:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.363145:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:0.0:1788521446.363155:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:2345:x1875400346139264:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521446.363169:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521446.363175:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.363189:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.363210:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb000/0x53df1cebae01724b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b1 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.363241:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:0.0:1788521446.363245:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.363254:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.363261:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.363292:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521446.363351:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+20:2345:x1875400346139264:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 197us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521446.363358:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00010000:00010000:2.0:1788521446.363471:0:6713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363479:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363507:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363520:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363534:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363540:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521446.363544:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363552:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363570:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:2.0:1788521446.363573:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788521446.363576:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.363582:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b600/0x53df1cebae017291 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.363639:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+19:11602:x1875400346139136:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 8231us (8687us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788521446.363660:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:2.0:1788521446.367448:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.367759:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346139392 00000100:00100000:0.0:1788521446.367770:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346139392 00000100:00100000:1.0:1788521446.368097:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:1.0:1788521446.368127:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346139392:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788521446.368176:0:12534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.368197:0:12534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.368207:0:12534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521446.368212:0:12534:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788521446.368216:0:12534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.368252:0:12534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.368265:0:12534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 8 pid: 6690 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.368280:0:12534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12534:1875400368142208:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521446.368364:0:12534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da180 going to sleep for 11 seconds 00000100:00100000:0.0:1788521446.373468:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.373487:0:12534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12534:1875400368142208:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521446.373521:0:12534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521446.373612:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346139520 00000100:00100000:3.0:1788521446.373624:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346139520 00010000:00010000:3.0:1788521446.373655:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 9 pid: 6690 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521446.373688:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:3.0:1788521446.373700:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+9:2346:x1875400346139520:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788521446.373717:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521446.373747:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 9 pid: 6690 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.373760:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 9 pid: 6690 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.373807:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da07fb4e/0x53df1cebae017275 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406cd expref: 9 pid: 6690 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.373845:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521446.373849:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521446.373856:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521446.373865:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374097:0:12534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374115:0:12534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374146:0:12534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374155:0:12534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374164:0:12534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374172:0:12534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521446.374177:0:12534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374187:0:12534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374201:0:12534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.374209:0:12534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2337e4e/0x53df1cebae017298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.374300:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346139392:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 6175us (6862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.374309:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00010000:00010000:3.0:1788521446.375234:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521446.377046:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2346:x1875400346139520:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 3337us (3579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.377060:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00010000:00010000:1.0:1788521446.377258:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521446.378183:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521446.378264:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346139776 00000100:00100000:2.0:1788521446.378274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346139776 00000100:00100000:2.0:1788521446.378328:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:2.0:1788521446.378339:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:11602:x1875400346139776:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788521446.378438:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378457:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378468:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378693:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378705:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378714:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378747:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 20 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.378760:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 20 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.378828:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368142336:192.168.203.48@tcp:104: 00000100:00100000:2.0:1788521446.378906:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70a8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788521446.385076:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.385266:0:8520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346139904 00000100:00100000:1.0:1788521446.385280:0:8520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346139904 00010000:00010000:1.0:1788521446.385327:0:8520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.385371:0:8520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1788521446.385381:0:8520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:2345:x1875400346139904:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521446.385395:0:8520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521446.385401:0:8520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.385425:0:8520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 21 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.385449:0:8520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:1.0:1788521446.385454:0:8520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.385465:0:8520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.385491:0:8520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.385513:0:8520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521446.385592:0:8520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ec78abe-db90-4086-b379-6c867e47751e+21:2345:x1875400346139904:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 205us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.385599:0:8520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00010000:00010000:2.0:1788521446.386028:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb400/0x53df1cebae017259 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406b8 expref: 20 pid: 6713 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521446.386052:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368142336:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521446.386100:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.386112:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.386119:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521446.386325:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788521446.386481:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788521446.386540:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788521446.387487:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368142464:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788521446.387702:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521446.387746:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a45b7ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788521446.387918:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368142464 00000100:00100000:3.0:1788521446.387926:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368142464 00000100:00100000:3.0:1788521446.387973:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521446.387982:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368142464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788521446.388079:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368142464:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521446.388088:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521446.388159:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1788521446.388166:0:5832:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1788521446.388194:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fb7b80, transno 4294967321 00000100:00100000:1.0:1788521446.388812:0:5832:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8c0a81fb4000 x1875400368141568/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788521462 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521446.388837:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a458e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368142464:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788521446.389340:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788521446.389455:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368142592:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788521446.389517:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521446.389554:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521446.389735:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368142592 00000100:00100000:0.0:1788521446.389744:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368142592 00000100:00100000:0.0:1788521446.389823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521446.389834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5832:x1875400368142592:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788521446.390036:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5832:x1875400368142592:12345-0@lo:1000:mdt00_000.0 Request processed in 204us (518us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788521446.390043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521446.392107:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5832:1875400368142592:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788521446.392167:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392178:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392186:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392217:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521446.392221:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392229:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392246:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737a00) 00010000:00010000:1.0:1788521446.392249:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521446.392254:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392261:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392299:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392306:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392312:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392317:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521446.392320:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392325:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392345:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521446.392347:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521446.392355:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392366:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392375:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.392423:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521446.392438:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f191f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368142720:192.168.203.48@tcp:105: 00000100:00100000:1.0:1788521446.392532:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7b9da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521446.398306:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f191f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5832:1875400368142720:192.168.203.48@tcp:105: 00000100:00100000:3.0:1788521446.398800:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1788521446.399072:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399085:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae0171e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399124:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399140:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399171:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399182:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399189:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399195:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399201:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521446.399205:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399213:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399224:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521446.399227:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521446.399231:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399237:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae0172ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399247:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399253:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399264:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399270:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521446.399273:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399280:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399289:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521446.399292:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521446.399294:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.399301:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01729f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.399521:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346140032 00000100:00100000:0.0:1788521446.399531:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346140032 00000100:00100000:0.0:1788521446.399600:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:0.0:1788521446.399610:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+24:11601:x1875400346140032:12345-192.168.203.48@tcp:49:lfs.0 00000100:00100000:0.0:1788521446.401166:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+24:11601:x1875400346140032:12345-192.168.203.48@tcp:49:lfs.0 Request processed in 1545us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521446.401180:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:1.0:1788521446.402297:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+23:11602:x1875400346139776:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 23954us (24114us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788521446.402309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 230 00000020:00080000:1.0:1788521446.402314:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788521446.402515:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521446.402520:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521446.403329:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788521446.403341:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521446.407516:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.412068:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521446.412175:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346140544 00000100:00100000:1.0:1788521446.412187:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346140544 00000100:00100000:1.0:1788521446.412261:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00100000:1.0:1788521446.412272:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+23:11601:x1875400346140544:12345-192.168.203.48@tcp:58:lfs.0 00000100:00100000:2.0:1788521446.412826:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346140288 00000100:00100000:2.0:1788521446.412831:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346140288 00000100:00100000:2.0:1788521446.413043:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:2.0:1788521446.413053:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a46850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+24:11602:x1875400346140288:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1788521446.413506:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788521446.413602:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+25:11601:x1875400346140544:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 1330us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521446.413622:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 231 00000004:00080000:2.0:1788521446.413630:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788521446.413733:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788521446.413792:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.413808:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.413820:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.413828:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.413834:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.413840:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.413857:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788521446.413917:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a46850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+25:11602:x1875400346140288:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 866us (6414us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788521446.413924:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000020:00080000:2.0:1788521446.413927:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788521446.415164:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521446.415175:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.415185:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521446.415190:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.415199:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.415216:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521446.415218:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788521446.415223:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.415230:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0172b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521446.415252:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521446.415254:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521446.415256:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521446.475428:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.475536:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346140672 00000100:00100000:3.0:1788521446.475565:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346140672 00000100:00100000:3.0:1788521446.475852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00100000:3.0:1788521446.475865:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+25:11604:x1875400346140672:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521446.475903:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521446.475929:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406d4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476299:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476329:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476343:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476359:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476366:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476373:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476679:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476691:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476699:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476736:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.476760:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 26 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.476805:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368142848:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521446.476917:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521446.480901:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521446.481371:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346140928 00000100:00100000:3.0:1788521446.481381:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346140928 00000100:00100000:3.0:1788521446.481452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1788521446.481462:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+27:5586:x1875400346140928:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788521446.481462:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5833:1875400368142848:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521446.481493:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.482364:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+28:5586:x1875400346140928:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 898us (1469us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788521446.482373:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1788521446.488890:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521446.490515:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346141056 00000100:00100000:0.0:1788521446.490536:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346141056 00010000:00010000:0.0:1788521446.490719:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 28 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521446.490884:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:0.0:1788521446.490908:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+28:2345:x1875400346141056:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521446.490925:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521446.490933:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 28 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.490947:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 28 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.490971:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae0171db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440695 expref: 28 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.491016:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521446.491021:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.491032:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.491040:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521446.491124:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521446.491206:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ec78abe-db90-4086-b379-6c867e47751e+27:2345:x1875400346141056:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 309us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521446.491214:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00010000:00010000:2.0:1788521446.496420:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.496460:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521446.497268:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788521446.497274:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521446.497299:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497318:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497328:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497335:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497341:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497348:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521446.497352:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497362:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497381:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:2.0:1788521446.497385:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521446.497391:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497424:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0172c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497446:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497453:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497459:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497463:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521446.497466:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497472:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497490:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8c0a4fa31f00) 00010000:00010000:2.0:1788521446.497493:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521446.497496:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497503:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f000/0x53df1cebae0172c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497559:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406d4 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497579:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406d4 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521446.497605:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:2.0:1788521446.497607:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521446.497610:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6ea00, rc 0) 00000100:00100000:2.0:1788521446.497695:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+26:11604:x1875400346140672:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 21831us (22388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521446.497705:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 232 00010000:00010000:1.0:1788521447.401293:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521447.451046:0:12573:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521447.451054:0:12573:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521447.451088:0:12573:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788521447.451100:0:12573:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788521447.465983:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521447.466063:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521447.466131:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788521447.466139:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788521447.466292:0:11694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368142976:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521447.466394:0:11694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a457c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521447.472372:0:11694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11694:1875400368142976:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521447.473374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521447.473505:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346141184 00000100:00100000:3.0:1788521447.473513:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346141184 00000100:00100000:3.0:1788521447.473566:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 233 00000100:00100000:3.0:1788521447.473576:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+26:11615:x1875400346141184:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521447.473609:0:6713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521447.473703:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+26:11615:x1875400346141184:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521447.473711:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 233 00000100:00100000:1.0:1788521447.488198:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521447.488323:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346141440 00000100:00100000:3.0:1788521447.488333:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346141440 00000100:00100000:3.0:1788521447.488397:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 234 00000100:00100000:3.0:1788521447.488418:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+26:11615:x1875400346141440:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521447.488445:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521447.488466:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae0172d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406db expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521447.488566:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521447.488582:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521447.488593:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521447.488604:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788521447.488732:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030200/0x53df1cebae0172d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406db expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521447.488752:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406db expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521447.488761:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:3.0:1788521447.488763:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788521447.488767:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030000, rc 0) 00000100:00100000:3.0:1788521447.488871:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f191f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+28:11615:x1875400346141440:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 456us (682us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788521447.488879:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 234 00000100:00100000:3.0:1788521447.492891:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521447.494453:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346141568 00000100:00100000:0.0:1788521447.494464:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346141568 00000100:00100000:0.0:1788521447.494547:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1788521447.494559:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+28:2348:x1875400346141568:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521447.494591:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521447.494615:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae0172de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406db expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521447.494636:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:0.0:1788521447.494641:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521447.494707:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60ae8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ec78abe-db90-4086-b379-6c867e47751e+27:2348:x1875400346141568:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 150us (1835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521447.494714:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1788521447.498257:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521447.498364:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346141824 00000100:00100000:1.0:1788521447.498375:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346141824 00000100:00100000:1.0:1788521447.498471:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00100000:1.0:1788521447.498483:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+27:11615:x1875400346141824:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788521447.498593:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.498630:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.498654:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.498892:0:6713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.498901:0:6713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.498909:0:6713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.499141:0:6713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521447.499146:0:6713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.499154:0:6713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.499240:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521447.499245:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521447.499250:0:6713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521447.499257:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a000/0x53df1cebae0172ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521447.499488:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+28:11615:x1875400346141824:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 1004us (1239us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788521447.499507:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 235 00000040:00080000:0.0:1788521447.502801:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788521447.502809:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521447.503285:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788521447.503294:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521447.504904:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521447.505915:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142080 00000100:00100000:2.0:1788521447.505926:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142080 00000100:00100000:2.0:1788521447.505980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1788521447.506993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+28:11615:x1875400346142080:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521447.508849:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+29:11615:x1875400346142080:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1953us (3942us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788521447.508862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:0.0:1788521447.530218:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521447.530242:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368143104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521447.530307:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521447.530364:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143104 00000100:00100000:0.0:1788521447.530372:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143104 00000100:00100000:0.0:1788521447.530432:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521447.530442:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368143104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521447.530466:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788521447.530512:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368143104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521447.530532:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521447.530583:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368143104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521447.531603:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368143616:0@lo:400:kworker.0 00000100:00100000:3.0:1788521447.531663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521447.531692:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788521447.531698:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368143488:0@lo:400:kworker.0 00000100:00100000:3.0:1788521447.531725:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521447.531758:0:12535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143616 00000100:00100000:3.0:1788521447.531764:0:12535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143616 00000100:00100000:3.0:1788521447.531885:0:12535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788521447.531895:0:12535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368143616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521447.531950:0:12535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368143616:12345-0@lo:400:kworker.0 Request processed in 57us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521447.531956:0:12535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788521447.531977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143488 00000100:00100000:3.0:1788521447.531981:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143488 00000100:00100000:3.0:1788521447.532007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788521447.532014:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368143488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521447.532045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1875400368143488:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521447.532051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788521447.532088:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1875400368143488:0@lo:400:kworker.0 00000100:00100000:3.0:1788521447.532099:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f25bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368143616:0@lo:400:kworker.0 00000100:00080000:2.0:1788521447.533359:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788521447.533367:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521447.533560:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368143232:0@lo:400:kworker.0 00000100:00100000:1.0:1788521447.533617:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521447.533662:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368143744:0@lo:400:kworker.0 00000100:00100000:1.0:1788521447.533695:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521447.533925:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521447.533934:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368143360:0@lo:400:kworker.0 00000100:00100000:1.0:1788521447.533963:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521447.534579:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143232 00000100:00100000:0.0:1788521447.534603:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143232 00000100:00100000:0.0:1788521447.534658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788521447.534674:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368143232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521447.534695:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143744 00000100:00100000:2.0:1788521447.534701:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143744 00000100:00100000:0.0:1788521447.534745:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a46235450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368143232:12345-0@lo:400:kworker.0 Request processed in 72us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521447.534753:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788521447.534759:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143360 00000100:00100000:2.0:1788521447.534763:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143360 00000100:00100000:2.0:1788521447.534810:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788521447.534818:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368143744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521447.534857:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f190700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368143744:12345-0@lo:400:kworker.0 Request processed in 40us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521447.534863:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788521447.534878:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788521447.534885:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368143360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521447.534926:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368143360:12345-0@lo:400:kworker.0 Request processed in 41us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521447.534933:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788521447.534954:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521447.535332:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368143360:0@lo:400:kworker.0 00000100:00100000:0.0:1788521447.535346:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368143232:0@lo:400:kworker.0 00000100:00100000:0.0:1788521447.535359:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368143744:0@lo:400:kworker.0 00000001:00080000:0.0:1788521447.604206:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788521447.604217:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1788521448.425273:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521449.448986:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521449.575849:0:12626:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521449.575861:0:12626:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521449.575911:0:12626:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788521449.575917:0:12626:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788521449.587120:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521449.587156:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521449.587185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521449.587210:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521449.587263:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521449.587298:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142208 00000100:00100000:3.0:1788521449.587307:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142208 00000100:00100000:3.0:1788521449.587349:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 299 00000100:00100000:3.0:1788521449.587358:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346142208:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521449.587435:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346142208:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 78us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521449.587444:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 299 00000100:00100000:3.0:1788521449.587480:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142592 00000100:00100000:3.0:1788521449.587484:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142592 00000100:00100000:3.0:1788521449.587522:0:8219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142464 00000100:00100000:3.0:1788521449.587526:0:8219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142464 00000100:00100000:3.0:1788521449.587556:0:8219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:1.0:1788521449.587685:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:1.0:1788521449.587696:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346142464:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521449.587730:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346142464:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 36us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521449.587737:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:3.0:1788521449.588302:0:8219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346142592:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521449.588334:0:8219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346142592:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 772us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521449.588342:0:8219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:3.0:1788521449.588368:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142336 00000100:00100000:3.0:1788521449.588372:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142336 00000100:00100000:3.0:1788521449.588419:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142720 00000100:00100000:3.0:1788521449.588422:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142720 00000100:00100000:3.0:1788521449.588442:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:3.0:1788521449.588448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6dfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+29:2345:x1875400346142336:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521449.588479:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6dfb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+29:2345:x1875400346142336:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521449.588486:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:3.0:1788521449.588502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:3.0:1788521449.588520:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346142720:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521449.588553:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346142720:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 34us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521449.588559:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00080000:3.0:1788521449.589302:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521449.589307:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521449.589309:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521449.810702:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521449.810815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346142976 00000100:00100000:1.0:1788521449.810824:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346142976 00000100:00100000:1.0:1788521449.810881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:1.0:1788521449.810891:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a458e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+29:11636:x1875400346142976:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521449.810911:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521449.810946:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0172f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406e2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521449.811046:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0172fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521449.811060:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0172fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521449.811070:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0172fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521449.811080:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788521449.811360:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575a400/0x53df1cebae0172f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406e2 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521449.811380:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0172fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406e2 expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521449.811398:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521449.811401:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788521449.811405:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b200, rc 0) 00000100:00100000:1.0:1788521449.811460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a458e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0ec78abe-db90-4086-b379-6c867e47751e+31:11636:x1875400346142976:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 570us (767us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788521449.811466:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:3.0:1788521449.819117:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521449.819197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143104 00000100:00100000:2.0:1788521449.819207:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143104 00000100:00100000:2.0:1788521449.819266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:2.0:1788521449.819276:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+31:11636:x1875400346143104:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521449.819344:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819362:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819374:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819410:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819418:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819425:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819431:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521449.819436:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819444:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819468:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:2.0:1788521449.819471:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521449.819476:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521449.819483:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521449.819563:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f25bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0ec78abe-db90-4086-b379-6c867e47751e+31:11636:x1875400346143104:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 288us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521449.819571:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:3.0:1788521449.933241:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521449.933366:0:12535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143232 00000100:00100000:0.0:1788521449.933374:0:12535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143232 00000100:00100000:0.0:1788521449.933439:0:12535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:0.0:1788521449.933448:0:12535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346143232:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:0.0:1788521449.933464:0:12535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521449.933484:0:12535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001330041c/0x53df1cebae01730f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406e9 expref: -99 pid: 12535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521449.933507:0:12535:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9aabe5, atime: 0x6a9aabe4, ctime: 0x6a9aabe5, blocks: 0xb 00010000:00010000:0.0:1788521449.933525:0:12535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=371s v=(0 0) 00010000:00010000:0.0:1788521449.933529:0:12535:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521449.933538:0:12535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001330041c/0x53df1cebae01730f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406e9 expref: 8 pid: 12535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521449.933573:0:12535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001330041c/0x53df1cebae01730f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406e9 expref: 8 pid: 12535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521449.933585:0:12535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e800, rc 0) 00000100:00100000:0.0:1788521449.933638:0:12535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0ec78abe-db90-4086-b379-6c867e47751e+8:2345:x1875400346143232:12345-192.168.203.48@tcp:101:cat.0 Request processed in 191us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521449.933644:0:12535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:2.0:1788521449.947065:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521449.949319:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143360 00000100:00100000:3.0:1788521449.949335:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143360 00002000:00100000:3.0:1788521449.949417:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8c0a6e3d6680 x1875400346143360/t0(0) o3->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:450/0 lens 488/0 e 0 to 0 dl 1788521460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521449.949430:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6e3d6680 with x1875400346143360 ext(0->4095) 00002000:00010000:3.0:1788521449.949438:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a6e3d6680 00000100:00100000:3.0:1788521449.949471:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521449.949482:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346143360:12345-192.168.203.48@tcp:3:cat.0 00000100:00100000:3.0:1788521449.949704:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0ec78abe-db90-4086-b379-6c867e47751e+8:2346:x1875400346143360:12345-192.168.203.48@tcp:3:cat.0 Request processed in 223us (2651us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788521449.949713:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00002000:00100000:3.0:1788521449.949720:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8c0a6e3d6680 x1875400346143360/t0(0) o3->0ec78abe-db90-4086-b379-6c867e47751e@192.168.203.48@tcp:450/0 lens 488/4536 e 0 to 0 dl 1788521460 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788521449.949727:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0a6e3d6680 with x1875400346143360 ext(0->4095) 00002000:00010000:3.0:1788521449.949731:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0a6e3d6680 00010000:00010000:1.0:1788521450.475666:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521451.113033:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368143872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521451.113117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521451.113355:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368143872 00000100:00100000:1.0:1788521451.113365:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368143872 00000100:00100000:1.0:1788521451.113433:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788521451.113443:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368143872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521451.113485:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521451.113533:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368143872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521451.113539:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788521451.113713:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521451.113747:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788521451.113753:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788521451.113797:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fb6680, transno 4294967310 00000100:00100000:2.0:1788521451.113822:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368143872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521451.497241:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788521451.633017:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788521451.633027:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788521451.633084:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788521451.633091:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1788521451.751089:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1788521451.751114:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1788521451.751884:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000001:00080000:0.0:1788521451.751896:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788521451.751912:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c0a7b9da000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788521451.751917:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a44876d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a7b9da180 00000020:00080000:0.0:1788521451.751921:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c0a44876f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c0a7f2f6c00 00000020:00080000:0.0:1788521451.751947:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788521451.752101:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788521451.752285:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788521452.521073:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521452.649598:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.649668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521452.649733:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368144640:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.649760:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521452.649811:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788521452.649817:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.649847:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521452.649870:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368144512:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.649890:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521452.649913:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368144256:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.649937:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521452.649957:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521452.649962:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.649991:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521452.650033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144128 00000100:00100000:3.0:1788521452.650043:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144128 00000100:00100000:3.0:1788521452.650091:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144512 00000100:00100000:3.0:1788521452.650094:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144512 00000100:00100000:3.0:1788521452.650117:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144256 00000100:00100000:3.0:1788521452.650120:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144256 00000100:00100000:3.0:1788521452.650132:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521452.650140:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368144128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368144128:12345-0@lo:400:kworker.0 Request processed in 54us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521452.650203:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788521452.650234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521452.650240:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368144512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650269:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368144512:12345-0@lo:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521452.650275:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788521452.650288:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521452.650294:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368144256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650321:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368144256:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521452.650326:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788521452.650344:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144640 00000100:00100000:3.0:1788521452.650347:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144640 00000100:00100000:3.0:1788521452.650385:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144384 00000100:00100000:3.0:1788521452.650388:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144384 00000100:00100000:3.0:1788521452.650405:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788521452.650411:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368144640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650438:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368144640:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521452.650444:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788521452.650453:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521452.650458:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368144384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650479:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368144384:12345-0@lo:400:kworker.0 Request processed in 21us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521452.650485:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788521452.650499:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144000 00000100:00100000:3.0:1788521452.650502:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144000 00000100:00100000:3.0:1788521452.650521:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788521452.650533:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368144000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650559:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368144000:12345-0@lo:400:kworker.0 Request processed in 27us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521452.650565:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00080000:3.0:1788521452.650599:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521452.650604:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521452.650635:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368144384:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650646:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368144256:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650671:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368144000:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650679:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368144512:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650687:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368144128:0@lo:400:kworker.0 00000100:00100000:3.0:1788521452.650694:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788521452.650699:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fb4000, transno 4294967322 00000004:00080000:3.0:1788521452.650707:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788521452.650721:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368144640:0@lo:400:kworker.0 00000100:00100000:0.0:1788521452.651347:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521452.651360:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368144768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521452.651410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521452.653807:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144768 00000100:00100000:1.0:1788521452.653824:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144768 00000100:00100000:1.0:1788521452.653898:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788521452.653910:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368144768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521452.653951:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521452.654039:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368144768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521452.654046:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788521452.655709:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368144768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788521453.545070:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521454.569100:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521454.706336:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521454.706413:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521454.706452:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521454.706477:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521454.706500:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521454.706546:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144000 00000100:00100000:3.0:1788521454.706559:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144000 00000100:00100000:3.0:1788521454.706643:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143616 00000100:00100000:3.0:1788521454.706647:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143616 00000100:00100000:3.0:1788521454.706695:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:3.0:1788521454.706708:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346144000:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521454.706867:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2345:x1875400346144000:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 161us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521454.706875:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:3.0:1788521454.706897:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:3.0:1788521454.706903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:2345:x1875400346143616:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521454.706934:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:2345:x1875400346143616:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521454.706940:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:3.0:1788521454.707544:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143744 00000100:00100000:3.0:1788521454.707550:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143744 00000100:00100000:3.0:1788521454.707591:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143872 00000100:00100000:3.0:1788521454.707594:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143872 00000100:00100000:3.0:1788521454.707826:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:3.0:1788521454.707837:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346143744:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521454.707889:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+5:2345:x1875400346143744:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 55us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521454.707896:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:3.0:1788521454.707912:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:3.0:1788521454.707919:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346143872:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521454.707949:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2345:x1875400346143872:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 30us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521454.707955:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00080000:3.0:1788521454.709113:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521454.709139:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521454.709144:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521454.709170:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346143488 00000100:00100000:1.0:1788521454.709184:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346143488 00000100:00100000:1.0:1788521454.709252:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 301 00000100:00100000:1.0:1788521454.709264:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346143488:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521454.709329:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2345:x1875400346143488:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 68us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521454.709336:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 301 00000100:00100000:1.0:1788521455.376518:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521455.377198:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144128 00000100:00100000:3.0:1788521455.377217:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144128 00000100:00100000:3.0:1788521455.377297:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:3.0:1788521455.377309:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:11279:x1875400346144128:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788521455.377469:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:11279:x1875400346144128:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 161us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521455.377477:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:3.0:1788521455.382167:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521455.382367:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144384 00000100:00100000:0.0:1788521455.382381:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144384 00000100:00100000:0.0:1788521455.382461:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:0.0:1788521455.382733:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+18:11279:x1875400346144384:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788521455.385327:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+19:11279:x1875400346144384:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 2589us (3164us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788521455.385342:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:1.0:1788521455.593067:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521455.602210:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521455.602341:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144512 00000100:00100000:1.0:1788521455.602365:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144512 00000100:00100000:1.0:1788521455.602454:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:1.0:1788521455.602475:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+5:12088:x1875400346144512:12345-192.168.203.48@tcp:101:lsof.0 00010000:00010000:1.0:1788521455.602514:0:6713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521455.602545:0:6713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017316 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64406f0 expref: -99 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521455.602638:0:6713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01731d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521455.602656:0:6713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01731d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521455.602672:0:6713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01731d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521455.602716:0:6713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521455.602721:0:6713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521455.602746:0:6713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01731d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521455.603662:0:6713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b000/0x53df1cebae017316 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406f0 expref: 7 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521455.603691:0:6713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01731d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406f0 expref: 6 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521455.603702:0:6713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:1.0:1788521455.603720:0:6713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521455.603725:0:6713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575bc00, rc 0) 00000100:00100000:1.0:1788521455.603941:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:12088:x1875400346144512:12345-192.168.203.48@tcp:101:lsof.0 Request processed in 1473us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521455.603951:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:0.0:1788521456.233285:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368144896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521456.233417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521456.233661:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368144896 00000100:00100000:1.0:1788521456.233675:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368144896 00000100:00100000:1.0:1788521456.233805:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788521456.233816:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368144896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521456.233864:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521456.233920:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368144896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521456.233927:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788521456.233997:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368144896:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788521456.234178:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788521456.618839:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521456.846193:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788521456.846216:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788521456.846271:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788521456.846285:0:5866:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788521457.641951:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521457.770652:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368145024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521457.770726:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521457.770896:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145024 00000100:00100000:1.0:1788521457.770903:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145024 00000100:00100000:1.0:1788521457.771023:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788521457.771035:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368145024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521457.771136:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521457.771254:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368145024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 221us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521457.771260:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788521457.771305:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368145024:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788521457.771390:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521457.774038:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368145280:0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.774152:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521457.774205:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521457.774212:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368145408:0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.774239:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521457.774307:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145280 00000100:00100000:0.0:1788521457.774309:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368145536:0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.774318:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145280 00000100:00100000:3.0:1788521457.774349:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6e3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368145152:0@lo:400:kworker.0 00000100:00100000:0.0:1788521457.774399:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521457.774405:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145408 00000100:00100000:3.0:1788521457.774406:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521457.774414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145408 00000100:00100000:2.0:1788521457.774466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788521457.774481:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368145280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521457.774532:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788521457.774551:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368145408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.774557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75411f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368145280:12345-0@lo:400:kworker.0 Request processed in 78us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521457.774560:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368145664:0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.774580:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788521457.774620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521457.774633:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368145408:12345-0@lo:400:kworker.0 Request processed in 89us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521457.774644:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788521457.774674:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145664 00000100:00100000:2.0:1788521457.774678:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368145408:0@lo:400:kworker.0 00000100:00100000:0.0:1788521457.774682:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145664 00000100:00100000:2.0:1788521457.774695:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e3d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368145280:0@lo:400:kworker.0 00000100:00100000:0.0:1788521457.774725:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788521457.774735:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368145664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.776587:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145152 00000100:00100000:2.0:1788521457.776605:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145152 00000100:00100000:3.0:1788521457.776660:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145536 00000100:00100000:3.0:1788521457.776677:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145536 00000100:00100000:2.0:1788521457.776692:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788521457.776708:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368145152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521457.776719:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368145664:12345-0@lo:400:kworker.0 Request processed in 1980us (2095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521457.776732:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1788521457.777129:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521457.777153:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521457.777164:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368145536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.777247:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368145152:12345-0@lo:400:kworker.0 Request processed in 541us (2842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521457.777257:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788521457.777265:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368145536:12345-0@lo:400:kworker.0 Request processed in 101us (2865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521457.777277:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788521457.777340:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75412680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368145536:0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.777380:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6e3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368145152:0@lo:400:kworker.0 00000100:00100000:2.0:1788521457.777405:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75411180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368145664:0@lo:400:kworker.0 00010000:00010000:3.0:1788521458.665164:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521459.293849:0:12829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:30:57 (1788521457) 00010000:00010000:1.0:1788521459.692028:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521459.826011:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521459.826503:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521459.826604:0:12535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144896 00000100:00100000:2.0:1788521459.826615:0:12535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144896 00000100:00100000:2.0:1788521459.826685:0:12535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:2.0:1788521459.826695:0:12535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346144896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:1.0:1788521459.826805:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521459.827743:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144640 00000100:00100000:0.0:1788521459.827753:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144640 00000100:00100000:2.0:1788521459.828020:0:12535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0ec78abe-db90-4086-b379-6c867e47751e+5:2347:x1875400346144896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 1320us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521459.828041:0:12535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:0.0:1788521459.828163:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 303 00000100:00100000:0.0:1788521459.828174:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346144640:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521459.828230:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346144640:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 59us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521459.828236:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 303 00000100:00100000:3.0:1788521459.829971:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521459.830042:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521459.830087:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521459.830137:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346145024 00000100:00100000:3.0:1788521459.830165:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346145024 00000100:00100000:3.0:1788521459.830251:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:3.0:1788521459.830262:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2347:x1875400346145024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521459.830343:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0ec78abe-db90-4086-b379-6c867e47751e+7:2347:x1875400346145024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 83us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521459.830351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00080000:3.0:1788521459.830378:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521459.830457:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346145152 00000100:00100000:1.0:1788521459.830463:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346145152 00000100:00100000:1.0:1788521459.830501:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346144768 00000100:00100000:1.0:1788521459.830504:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346144768 00000100:00100000:1.0:1788521459.830523:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:1.0:1788521459.830530:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:2347:x1875400346145152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521459.830594:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:2347:x1875400346145152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 63us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521459.830601:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:1.0:1788521459.830615:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:1.0:1788521459.830621:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+18:2347:x1875400346144768:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521459.830654:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0ec78abe-db90-4086-b379-6c867e47751e+18:2347:x1875400346144768:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 33us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521459.830660:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00080000:3.0:1788521459.830992:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788521460.717493:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521461.352982:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368145792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521461.353061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521461.353189:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145792 00000100:00100000:1.0:1788521461.353205:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145792 00000100:00100000:1.0:1788521461.353265:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788521461.353275:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368145792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521461.353319:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521461.353373:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368145792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521461.353380:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788521461.354031:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368145792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788521461.354489:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788521461.737355:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788521461.868901:0:11694:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788521461.868910:0:11694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788521461.870846:0:11694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788521461.870862:0:11694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788521462.773397:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521462.889205:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788521462.889235:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521462.889320:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521462.889657:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368146432:0@lo:400:kworker.0 00000100:00100000:3.0:1788521462.889690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521462.889713:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521462.889719:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368146304:0@lo:400:kworker.0 00000100:00100000:3.0:1788521462.889743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521462.889804:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368146176:0@lo:400:kworker.0 00000100:00100000:3.0:1788521462.889855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521462.889875:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788521462.889881:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368146048:0@lo:400:kworker.0 00000100:00100000:3.0:1788521462.889911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521462.889936:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7ab34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368146560:0@lo:400:kworker.0 00000100:00100000:3.0:1788521462.889957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521462.889985:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146304 00000100:00100000:3.0:1788521462.889994:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146304 00000100:00100000:3.0:1788521462.890043:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146176 00000100:00100000:3.0:1788521462.890046:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146176 00000100:00100000:3.0:1788521462.890056:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146560 00000100:00100000:0.0:1788521462.891282:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146432 00000100:00100000:0.0:1788521462.891317:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146432 00000100:00100000:0.0:1788521462.891373:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788521462.891383:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368146432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521462.891981:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146048 00000100:00100000:2.0:1788521462.891988:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146048 00000100:00100000:2.0:1788521462.892018:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788521462.892026:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368146048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521462.892050:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368145920 00000100:00100000:1.0:1788521462.892070:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368145920 00000100:00100000:1.0:1788521462.892121:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788521462.892129:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368145920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521462.892157:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521462.892177:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146560 00000100:00100000:3.0:1788521462.892210:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788521462.892211:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368145920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521462.892219:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ab36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368146304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521462.892226:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788521462.892266:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368146304:12345-0@lo:400:kworker.0 Request processed in 49us (2521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521462.892272:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788521462.892284:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7accaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368145920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521462.892288:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788521462.892315:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368146176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521462.892358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788521462.892371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368146560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521462.892372:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368146432:12345-0@lo:400:kworker.0 Request processed in 83us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521462.892385:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1788521462.892430:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521462.892435:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521462.892645:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3301:x1875400368146048:12345-0@lo:400:kworker.0 Request processed in 619us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521462.892652:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788521462.892981:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368146304:0@lo:400:kworker.0 00000100:00100000:0.0:1788521462.892997:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368146432:0@lo:400:kworker.0 00000100:00100000:3.0:1788521462.893491:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368146176:12345-0@lo:400:kworker.0 Request processed in 1192us (3632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521462.893500:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788521462.894102:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f193800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368146048:0@lo:400:kworker.0 00000100:00100000:2.0:1788521462.895106:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7ab34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368146560:0@lo:400:kworker.0 00000100:00100000:2.0:1788521462.895121:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368146176:0@lo:400:kworker.0 00000100:00100000:1.0:1788521462.895272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1875400368146560:12345-0@lo:400:kworker.0 Request processed in 2903us (5310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521462.895282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788521463.131632:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521463.131819:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346145408 00000100:00100000:1.0:1788521463.131829:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346145408 00000100:00100000:1.0:1788521463.131907:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:1.0:1788521463.131919:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+18:12309:x1875400346145408:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:1.0:1788521463.132305:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+19:12309:x1875400346145408:12345-192.168.203.48@tcp:35:umount.0 Request processed in 378us (673us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788521463.132313:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00080000:0.0:1788521463.132721:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521463.134876:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521463.135007:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346145664 00000100:00100000:3.0:1788521463.135016:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346145664 00000100:00100000:3.0:1788521463.135074:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:3.0:1788521463.135093:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+19:12309:x1875400346145664:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:3.0:1788521463.135521:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0ec78abe-db90-4086-b379-6c867e47751e+20:12309:x1875400346145664:12345-192.168.203.48@tcp:35:umount.0 Request processed in 429us (653us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788521463.135529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1788521463.147420:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521463.150539:0:11971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346145920 00000100:00100000:3.0:1788521463.150558:0:11971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346145920 00000100:00100000:3.0:1788521463.150763:0:11971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1788521463.150792:0:11971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a70a45450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+20:12309:x1875400346145920:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:3.0:1788521463.151044:0:11971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a70a45450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:12309:x1875400346145920:12345-192.168.203.48@tcp:35:umount.0 Request processed in 271us (3633us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788521463.151052:0:11971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:2.0:1788521463.162409:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521463.164638:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346146176 00000100:00100000:1.0:1788521463.164652:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346146176 00000100:00100000:1.0:1788521463.164795:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1788521463.164807:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+21:12309:x1875400346146176:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:1.0:1788521463.165171:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0ec78abe-db90-4086-b379-6c867e47751e+22:12309:x1875400346146176:12345-192.168.203.48@tcp:35:umount.0 Request processed in 366us (2771us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788521463.165179:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1788521463.182022:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521463.182068:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521463.182103:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521463.182133:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521463.182170:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346146816 00000100:00100000:0.0:1788521463.182181:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346146816 00000100:00100000:0.0:1788521463.182235:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346146688 00000100:00100000:0.0:1788521463.182239:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346146688 00000100:00100000:0.0:1788521463.182254:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346146944 00000100:00100000:0.0:1788521463.182256:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346146944 00000100:00100000:0.0:1788521463.182271:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:0.0:1788521463.182309:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+15:2347:x1875400346146816:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521463.182324:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521463.182344:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166f600/0x53df1cebae0162fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440243 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521463.182365:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521463.182423:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+14:2347:x1875400346146816:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 117us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521463.182429:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:0.0:1788521463.182515:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1788521463.182525:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+13:2347:x1875400346146688:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521463.182534:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521463.182543:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c5600/0x53df1cebae016333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644027b expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521463.182553:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521463.182570:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:2347:x1875400346146688:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 47us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521463.182576:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1788521463.182599:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1788521463.182605:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:2347:x1875400346146944:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521463.182613:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521463.182622:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82045e00/0x53df1cebae01657f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440346 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521463.182632:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521463.182657:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2347:x1875400346146944:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 53us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521463.182664:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1788521463.183992:0:12535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346146560 00000100:00100000:2.0:1788521463.184001:0:12535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346146560 00000100:00100000:2.0:1788521463.184057:0:12535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1788521463.184064:0:12535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0ec78abe-db90-4086-b379-6c867e47751e+7:2344:x1875400346146560:12345-192.168.203.48@tcp:9:umount.0 00000020:00000080:2.0:1788521463.184088:0:12535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0168d5 00000020:00010000:2.0:1788521463.184095:0:12535:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c0941156800: total 0 00000100:00080000:2.0:1788521463.184100:0:12535:0:(import.c:65:import_set_state_nolock()) ffff8c0941150000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788521463.184146:0:12535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788521463.184421:0:12535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0ec78abe-db90-4086-b379-6c867e47751e+5:2344:x1875400346146560:12345-192.168.203.48@tcp:9:umount.0 Request processed in 347us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521463.184427:0:12535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000020:00010000:1.0:1788521463.184709:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c0941156800: total 0 00010000:00010000:1.0:1788521463.184742:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c0941156800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788521463.184828:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001330041c/0x53df1cebae01730f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406e9 expref: 4 pid: 12535 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.184870:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ce2aee5/0x53df1cebae016c71 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644051b expref: 3 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.184884:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c0941156800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788521463.184895:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521463.184897:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521463.184898:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788521463.188135:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521463.196098:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521463.196204:0:12534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346147072 00000100:00100000:3.0:1788521463.196233:0:12534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346147072 00000100:00100000:3.0:1788521463.196321:0:12534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00080000:0.0:1788521463.196416:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521463.196560:0:12534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0ec78abe-db90-4086-b379-6c867e47751e+5:2344:x1875400346147072:12345-192.168.203.48@tcp:9:umount.0 00000020:00000080:3.0:1788521463.196594:0:12534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01666d 00000100:00080000:3.0:1788521463.196604:0:12534:0:(import.c:65:import_set_state_nolock()) ffff8c0a608db000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788521463.196656:0:12534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1788521463.196877:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521463.197584:0:12534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0ec78abe-db90-4086-b379-6c867e47751e+2:2344:x1875400346147072:12345-192.168.203.48@tcp:9:umount.0 Request processed in 1251us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521463.197595:0:12534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:2.0:1788521463.221943:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521463.222044:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148096 00000100:00100000:0.0:1788521463.222055:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148096 00000100:00100000:0.0:1788521463.222121:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:0.0:1788521463.222130:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+22:2344:x1875400346148096:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:0.0:1788521463.222175:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016309 00000020:00010000:0.0:1788521463.222194:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c0a7c4a9800: total 0 00000100:00080000:0.0:1788521463.222200:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8c0a75c0d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521463.222242:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788521463.222700:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0ec78abe-db90-4086-b379-6c867e47751e+21:2344:x1875400346148096:12345-192.168.203.48@tcp:39:umount.0 Request processed in 568us (765us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788521463.222710:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 240 00000020:00010000:1.0:1788521463.222818:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c0a7c4a9800: total 0 00010000:00010000:1.0:1788521463.222823:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521463.222862:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c0a7c4a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788521463.222899:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521463.222903:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521463.222912:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6ea00/0x53df1cebae0172d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406d4 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.222929:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:1.0:1788521463.222932:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521463.222936:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0000/0x53df1cebae016cd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440537 expref: 19 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.222969:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a65ff4900) 00010000:00010000:1.0:1788521463.222972:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521463.222976:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1a00/0x53df1cebae0165ef lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644035b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.222992:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521463.222995:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788521463.222998:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beba00/0x53df1cebae016c32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440506 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223009:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521463.223011:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788521463.223015:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea200/0x53df1cebae016c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440514 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223025:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521463.223027:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788521463.223031:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b200/0x53df1cebae0172fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406e2 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223042:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c0a4fa31600) 00010000:00010000:1.0:1788521463.223044:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521463.223048:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4200/0x53df1cebae0165d3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440354 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223064:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521463.223066:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788521463.223075:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a821c4000/0x53df1cebae016cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644053e expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223088:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8c0a65ff4c00) 00010000:00010000:1.0:1788521463.223090:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521463.223094:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb200/0x53df1cebae016fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440610 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223106:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8c0a65ff4a00) 00010000:00010000:1.0:1788521463.223109:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521463.223112:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae016b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64404ce expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223125:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521463.223127:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788521463.223130:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a82044200/0x53df1cebae016643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440370 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223141:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8c0a4fa31700) 00010000:00010000:1.0:1788521463.223144:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521463.223147:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beb600/0x53df1cebae0171f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644069c expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223160:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8c0a4fa31400) 00010000:00010000:1.0:1788521463.223162:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788521463.223165:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575b800/0x53df1cebae016930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440442 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521463.223177:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c0a7c4a9800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788521463.223192:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521463.223194:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521463.223196:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521463.785147:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521464.810732:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521464.941575:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521464.941624:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521464.941722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148224 00000100:00100000:0.0:1788521464.941731:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148224 00000100:00100000:0.0:1788521464.941821:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 305 00000100:00100000:0.0:1788521464.941831:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346148224:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521464.942181:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2348:x1875400346148224:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 351us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521464.942189:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 305 00000100:00100000:3.0:1788521464.942579:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148352 00000100:00100000:3.0:1788521464.942585:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148352 00000100:00100000:3.0:1788521464.942680:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:3.0:1788521464.942689:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:2348:x1875400346148352:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521464.942741:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7acc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:22124939-1de7-45f1-ae59-b0320dc01898+6:2348:x1875400346148352:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 53us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521464.942747:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00080000:0.0:1788521464.942803:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521465.043828:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521465.043864:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521465.043892:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521465.043961:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148480 00000100:00100000:0.0:1788521465.043969:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148480 00000100:00100000:0.0:1788521465.044026:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148736 00000100:00100000:0.0:1788521465.044029:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148736 00000100:00100000:0.0:1788521465.044039:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148608 00000100:00100000:0.0:1788521465.044041:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148608 00000100:00100000:0.0:1788521465.044054:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1788521465.044063:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+12:2347:x1875400346148480:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521465.044078:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521465.044095:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0800/0x53df1cebae0163db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440290 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521465.044113:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521465.044160:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7accaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+11:2347:x1875400346148480:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521465.044167:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1788521465.044182:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1788521465.044187:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+10:2347:x1875400346148736:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521465.044194:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521465.044202:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a7575be00/0x53df1cebae016578 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644033f expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521465.044210:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521465.044222:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f193800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+9:2347:x1875400346148736:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521465.044228:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1788521465.044237:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1788521465.044258:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+8:2347:x1875400346148608:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521465.044265:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521465.044272:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beac00/0x53df1cebae0163e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64402ba expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521465.044291:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521465.044306:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+7:2347:x1875400346148608:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 48us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521465.044312:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:2.0:1788521465.052667:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521465.052834:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346148992 00000100:00100000:0.0:1788521465.052844:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346148992 00000100:00100000:0.0:1788521465.052947:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 241 00000100:00100000:0.0:1788521465.052959:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6e3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+6:2344:x1875400346148992:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:0.0:1788521465.053000:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0163f0 00000020:00010000:0.0:1788521465.053010:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c0a81c04000: total 0 00000100:00080000:0.0:1788521465.053015:0:5834:0:(import.c:65:import_set_state_nolock()) ffff8c0a81c02000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521465.053050:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788521465.053307:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6e3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:22124939-1de7-45f1-ae59-b0320dc01898+5:2344:x1875400346148992:12345-192.168.203.48@tcp:39:umount.0 Request processed in 349us (648us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788521465.054231:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 241 00000020:00010000:1.0:1788521465.054350:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c0a81c04000: total 0 00010000:00010000:1.0:1788521465.054395:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c0a81c04000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788521465.054429:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:1.0:1788521465.054433:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521465.054442:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a7575bc00/0x53df1cebae01731d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64406f0 expref: 4 pid: 6713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521465.054472:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c0a81c04000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788521465.054482:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521465.054484:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521465.054486:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521465.088696:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521465.088949:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346149248 00000100:00100000:2.0:1788521465.088960:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346149248 00000100:00100000:2.0:1788521465.089029:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 306 00000100:00100000:2.0:1788521465.089062:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+7:2344:x1875400346149248:12345-192.168.203.48@tcp:251:umount.0 00000020:00000080:2.0:1788521465.089125:0:5828:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0162e6 00000020:00010000:2.0:1788521465.089136:0:5828:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c0a7f2b5800: total 0 00000100:00080000:2.0:1788521465.089141:0:5828:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f2b4000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788521465.089238:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de5f0d15-4053-4269-a3e1-52b1c2d87f1c+3:2344:x1875400346149248:12345-192.168.203.48@tcp:251:umount.0 Request processed in 179us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521465.089246:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 306 00000020:00010000:0.0:1788521465.089406:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c0a7f2b5800: total 0 00010000:00010000:0.0:1788521465.089410:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521465.089451:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c0a7f2b5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788521465.089484:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beaa00/0x53df1cebae01633a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440282 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521465.089503:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c0a7f2b5800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788521465.089519:0:5821:0:(genops.c:885:class_export_put()) final put ffff8c0a7f2b5800/de5f0d15-4053-4269-a3e1-52b1c2d87f1c 00010000:00010000:0.0:1788521465.089530:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521465.089532:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521465.089533:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788521465.089700:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f2b5800/de5f0d15-4053-4269-a3e1-52b1c2d87f1c for MGS 00000020:00000080:3.0:1788521465.089750:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7f2b4000 for MGS 00010000:00010000:1.0:1788521465.842162:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521466.473096:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368146688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521466.473169:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521466.473750:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146688 00000100:00100000:2.0:1788521466.473760:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146688 00000100:00100000:2.0:1788521466.473855:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788521466.473865:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368146688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521466.473902:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521466.473955:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368146688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521466.473962:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788521466.474645:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521466.474695:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368146688:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1788521466.793676:0:13025:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788521466.809168:0:13025:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788521466.809207:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.809217:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.809222:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.809227:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.809258:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788521466.809264:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788521466.809292:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521466.809298:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.809300:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521466.809304:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788521466.809305:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521466.809308:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.809309:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788521466.809316:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521466.809323:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521466.809328:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788521466.809330:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:2.0:1788521466.809331:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8c0a458fe800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:0.0:1788521466.809332:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788521466.809357:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521466.809363:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788521466.809400:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368146816:0@lo:39:umount.0 00000100:00100000:1.0:1788521466.809472:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521466.809554:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146816 00000100:00100000:1.0:1788521466.809561:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146816 00000100:00100000:1.0:1788521466.809619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788521466.809629:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875400368146816:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788521466.809654:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0160f5 00000100:00080000:1.0:1788521466.809663:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8c0a6e00c000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788521466.809723:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1875400368146816:12345-0@lo:39:umount.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521466.809730:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788521466.809740:0:5833:0:(genops.c:885:class_export_put()) final put ffff8c0a6e00f800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788521466.809964:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521466.809975:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a6e00f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1788521466.810675:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368146944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521466.810726:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:1.0:1788521466.816343:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a6e00c000 for lustre-MDT0000 00000100:00080000:1.0:1788521466.816417:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a458fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788521466.816436:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368146816:0@lo:39:umount.0 00010000:00010000:0.0:1788521466.817375:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.817602:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521466.817607:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788521466.817613:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788521466.817873:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0400/0x53df1cebae016379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016380 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521466.817889:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521466.817906:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521466.817909:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521466.817928:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368146944 00000100:00100000:0.0:1788521466.817935:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368146944 00000100:00100000:0.0:1788521466.818129:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788521466.818139:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3302:x1875400368146944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521466.818153:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521466.818171:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bebe00/0x53df1cebae016380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016379 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521466.818185:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521466.818257:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60ae9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3302:x1875400368146944:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (7530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521466.818265:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788521466.818358:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368146944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521466.819671:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819686:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819693:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819699:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819723:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521466.819729:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819753:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819759:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.819765:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820059:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788521466.820068:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820075:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820082:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820088:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820097:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788521466.820102:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820108:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820123:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820129:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521466.820136:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788521466.820139:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788521466.820169:0:13025:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788521466.820174:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788521466.820178:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521466.820183:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00010000:00010000:1.0:1788521466.820186:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:00080000:2.0:1788521466.820189:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0a7ab92800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521466.820195:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0a7f3b6800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521466.820202:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c0a81c04000 22124939-1de7-45f1-ae59-b0320dc01898 192.168.203.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1788521466.820204:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788521466.820207:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c0a7c4a9800 0ec78abe-db90-4086-b379-6c867e47751e 192.168.203.48@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00010000:00010000:1.0:1788521466.820211:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0200 already unused, calling callback (ffffffffc1ab4c20) 00000020:00080000:2.0:1788521466.820212:0:13025:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c0a45654d40) has exports, disconnecting them 10000000:00010000:1.0:1788521466.820215:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788521466.820217:0:13025:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0a7ab92800), last request at 1788521462 00010000:00010000:1.0:1788521466.820223:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788521466.820224:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016268 10000000:00010000:1.0:1788521466.820229:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521466.820235:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521466.820238:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000100:00080000:2.0:1788521466.820239:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab93000 : changing import state from FULL to CLOSED 10000000:01000000:1.0:1788521466.820240:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788521466.820284:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820291:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1788521466.820294:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0a7ab92800): rc 0 00000020:00000080:2.0:1788521466.820296:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a7ab92800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788521466.820305:0:13025:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0a7f3b6800), last request at 1788521462 00000020:00000080:2.0:1788521466.820308:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01619d 00010000:00010000:1.0:1788521466.820311:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.820314:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f3b4800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788521466.820318:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae016387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01638e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788521466.820319:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0a7f3b6800): rc 0 00000020:00000080:2.0:1788521466.820326:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a7f3b6800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788521466.820333:0:13025:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb00783803ae0 00010000:00010000:1.0:1788521466.820334:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788521466.820337:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820342:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a821c4400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521466.820344:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820351:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.820352:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788521466.820356:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 10000000:00010000:1.0:1788521466.820357:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521466.820361:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521466.820363:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788521466.820365:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000004:00080000:2.0:1788521466.820366:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788521466.820379:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820385:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521466.820404:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820412:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a821c4400/0x53df1cebae0162a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae0162a7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820424:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521466.820428:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820439:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ae00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521466.820442:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820449:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.820453:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 10000000:00010000:1.0:1788521466.820455:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521466.820459:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788521466.820461:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788521466.820463:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1788521466.820465:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8c0a7c4a8000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788521466.820474:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.820476:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788521466.820478:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:1.0:1788521466.820480:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:2.0:1788521466.820485:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788521466.820486:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820492:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae0165a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae0165a9 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820500:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521466.820504:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820509:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030800 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521466.820512:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820524:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521466.820531:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521466.820536:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521466.820538:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788521466.820540:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1788521466.820551:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:1.0:1788521466.820551:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820556:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521466.820561:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.820568:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40030800/0x53df1cebae016054 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01605b expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788521466.820569:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8c0a6dc8f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788521466.820578:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521466.820580:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521466.820582:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788521466.820594:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c0a45654d40) has no exports 00000100:00100000:1.0:1788521466.820595:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368147072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521466.820651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521466.820692:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788521466.820697:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368147584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521466.820716:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521466.820743:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147072 00000100:00100000:1.0:1788521466.820910:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147072 00000100:00100000:1.0:1788521466.820956:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147584 00000100:00100000:1.0:1788521466.820959:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147584 00000100:00100000:1.0:1788521466.820978:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521466.820987:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+19:3303:x1875400368147072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521466.820998:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521466.821010:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c5200/0x53df1cebae01638e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016387 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.821021:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521466.821055:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+18:3303:x1875400368147072:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521466.821062:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521466.821076:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521466.821082:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3303:x1875400368147584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521466.821090:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521466.821098:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82044800/0x53df1cebae01605b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016054 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521466.821109:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521466.821131:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3303:x1875400368147584:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521466.821137:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521466.821169:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368147584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521466.821178:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:02b855e8-b82d-4a25-90ff-ed0c016d947b:3303:1875400368147072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521466.821204:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368147328:0@lo:9:umount.0 00000100:00100000:1.0:1788521466.821231:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521466.821258:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368147712:0@lo:9:umount.0 00000100:00100000:1.0:1788521466.821291:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788521466.821312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7ab92800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788521466.821366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f3b6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788521466.821387:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7ab93000 for lustre-MDT0000 00000020:00000080:0.0:1788521466.821392:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7f3b4800 for lustre-MDT0000 00000100:00100000:0.0:1788521466.821406:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368147200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521466.821435:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521466.821462:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521466.821468:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368147456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521466.821487:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521466.821504:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147200 00000100:00100000:0.0:1788521466.821508:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147200 00000100:00100000:0.0:1788521466.821530:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147456 00000100:00100000:0.0:1788521466.821532:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147456 00000100:00100000:0.0:1788521466.821553:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521466.821558:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+17:3300:x1875400368147200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521466.821565:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521466.821574:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a82044c00/0x53df1cebae0162a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae0162a0 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521466.821584:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521466.821609:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+16:3300:x1875400368147200:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521466.821614:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521466.821625:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521466.821630:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+15:3300:x1875400368147456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521466.821635:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521466.821642:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beae00/0x53df1cebae0165a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae0165a2 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521466.821649:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521466.821665:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3300:x1875400368147456:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521466.821671:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788521466.821690:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147328 00000100:00100000:0.0:1788521466.821693:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147328 00000100:00100000:0.0:1788521466.821715:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147712 00000100:00100000:0.0:1788521466.821717:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147712 00000100:00100000:0.0:1788521466.821743:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521466.821749:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875400368147328:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788521466.821799:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0161ea 00000100:00080000:0.0:1788521466.821808:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f3b6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521466.821843:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1788521466.822938:0:5829:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788521466.824914:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3299:x1875400368147328:12345-0@lo:9:umount.0 Request processed in 3155us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521466.824927:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788521466.824953:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788521466.824965:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3299:x1875400368147712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788521466.825001:0:6690:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0162d1 00000100:00080000:0.0:1788521466.825012:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f2b2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788521466.825037:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788521466.825176:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3299:x1875400368147712:12345-0@lo:9:umount.0 Request processed in 215us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521466.825183:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788521466.825232:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368147456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521466.825243:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81c4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:02b855e8-b82d-4a25-90ff-ed0c016d947b:3300:1875400368147200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521466.825291:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521466.825297:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521466.825475:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7c4a8000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788521466.825498:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788521466.825500:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521466.825504:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368147328:0@lo:9:umount.0 00000100:00080000:2.0:1788521466.825517:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a6dc8f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788521466.825533:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788521466.825535:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521466.825537:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368147712:0@lo:9:umount.0 00000020:00080000:2.0:1788521466.837512:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c0a45654d40) has no exports 00000020:00000080:2.0:1788521466.878601:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0160af 00000020:00000080:2.0:1788521466.878618:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a6e00e800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788521466.878696:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00010000:00010000:3.0:1788521466.879055:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788521466.881740:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521466.881756:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788521466.881761:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c0a7b9f4d40) has no exports 00000020:00000080:0.0:1788521466.882358:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0160a8 00000020:00000080:0.0:1788521466.882367:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a7b9e6800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788521466.882530:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a6e00e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788521466.884038:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521466.884053:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788521466.884059:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a7b9e7800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788521466.884064:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7b9e7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788521466.884073:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788521466.885137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7b9e6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:2.0:1788521467.062722:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521467.062730:0:7652:0:(genops.c:885:class_export_put()) final put ffff8c0a7f2b0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788521467.062754:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:2.0:1788521467.062757:0:7652:0:(genops.c:885:class_export_put()) final put ffff8c0941156800/0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:3.0:1788521467.066616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f2b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788521467.066668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0941156800/0ec78abe-db90-4086-b379-6c867e47751e for lustre-OST0001 00000020:00000080:3.0:1788521467.066691:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7f2b2000 for lustre-OST0001 00000020:00000080:3.0:1788521467.066695:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0941150000 for lustre-OST0001 00000001:00100000:2.0:1788521467.081755:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 22124939-1de7-45f1-ae59-b0320dc01898 00000001:00080000:2.0:1788521467.081819:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788521467.081824:0:5854:0:(genops.c:885:class_export_put()) final put ffff8c0a81c04000/22124939-1de7-45f1-ae59-b0320dc01898 00000001:00100000:2.0:1788521467.081841:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000001:00080000:2.0:1788521467.081846:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788521467.081868:0:5854:0:(genops.c:885:class_export_put()) final put ffff8c0a7c4a9800/0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:1.0:1788521467.085232:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a81c04000/22124939-1de7-45f1-ae59-b0320dc01898 for lustre-MDT0000 00000020:00000080:1.0:1788521467.085319:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7c4a9800/0ec78abe-db90-4086-b379-6c867e47751e for lustre-MDT0000 00000020:00000080:1.0:1788521467.085356:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a81c02000 for lustre-MDT0000 00000020:00000080:1.0:1788521467.085361:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a75c0d800 for lustre-MDT0000 00010000:00010000:0.0:1788521467.881332:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521468.008981:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788521468.009003:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368148096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521468.009013:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368147840:0@lo:400:kworker.0 00000100:00100000:2.0:1788521468.009320:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368147968:0@lo:400:kworker.0 00000100:00100000:0.0:1788521468.016739:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521468.016825:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147840 00000100:00100000:0.0:1788521468.016833:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147840 00000100:00100000:0.0:1788521468.016884:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788521468.016894:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3302:x1875400368147840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521468.016951:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a465cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:02b855e8-b82d-4a25-90ff-ed0c016d947b+14:3302:x1875400368147840:12345-0@lo:400:kworker.0 Request processed in 58us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521468.016958:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788521468.016979:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521468.017016:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368147840:0@lo:400:kworker.0 00000100:00100000:3.0:1788521468.017023:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368148096 00000100:00100000:3.0:1788521468.017028:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368148096 00000100:00100000:3.0:1788521468.017058:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788521468.017064:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875400368148096:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788521468.017071:0:5832:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788521468.017163:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1875400368148096:12345-0@lo:400:kworker.0 Request processed in 98us (186us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788521468.017169:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788521468.019391:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521468.019460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368147968 00000100:00100000:2.0:1788521468.019469:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368147968 00000100:00100000:2.0:1788521468.019502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788521468.019510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1875400368147968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788521468.019519:0:5833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788521468.019557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3300:x1875400368147968:12345-0@lo:400:kworker.0 Request processed in 47us (172us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788521468.019564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1788521468.019597:0:3300:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788521468.019602:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f66f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788521468.019605:0:3300:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788521468.020575:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788521468.020598:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab95800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788521468.020602:0:3301:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788521468.020607:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab95800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788521468.020612:0:3301:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 191 00000100:00080000:0.0:1788521468.020619:0:3301:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0a7ab95800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521468.020648:0:3301:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a75b0f100 x1875400368148224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521468.020672:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1875400368148096:0@lo:400:kworker.0 00000100:00100000:1.0:1788521468.021247:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368148224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788521468.021321:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521468.021451:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368148224 00000100:00100000:3.0:1788521468.021458:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368148224 00000100:00100000:3.0:1788521468.021503:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788521468.021521:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875400368148224:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1788521468.021536:0:6713:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788521468.052134:0:3300:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f66f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521468.052143:0:3300:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 170 00000100:00080000:2.0:1788521468.052152:0:3300:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0a7f66f000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521468.052187:0:3300:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0941355c00 x1875400368148352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521468.052231:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368147968:0@lo:400:kworker.0 00000100:00100000:1.0:1788521468.052286:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875400368148352:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788521468.052350:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521468.053187:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368148352 00000100:00100000:2.0:1788521468.053198:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368148352 00000100:00100000:2.0:1788521468.053246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788521468.053253:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875400368148352:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1788521468.053278:0:5833:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788521468.053336:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3299:x1875400368148352:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 82us (985us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788521468.053344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1788521468.059321:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f66f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521468.059330:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788521468.059336:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875400368148352:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1788521468.079988:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81c4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1875400368148224:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 58457us (58657us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788521468.080003:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:0.0:1788521468.080058:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab95800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521468.080066:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788521468.080071:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368148224:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:1.0:1788521468.096679:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788521468.096689:0:6716:0:(genops.c:885:class_export_put()) final put ffff8c0a7f3b0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788521468.096714:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:1.0:1788521468.096718:0:6716:0:(genops.c:885:class_export_put()) final put ffff8c0a7f1d5800/0ec78abe-db90-4086-b379-6c867e47751e 00000020:00000080:3.0:1788521468.097195:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f3b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788521468.097243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f1d5800/0ec78abe-db90-4086-b379-6c867e47751e for lustre-OST0000 00000020:00000080:3.0:1788521468.097275:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7f3b6000 for lustre-OST0000 00000020:00000080:3.0:1788521468.097279:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a608db000 for lustre-OST0000 00000020:01000000:0.0:1788521468.904891:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c09438e0600 - data ffff8c0a7f857288/ffff8c0a7f1d9800 00000020:01000000:0.0:1788521468.905025:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a48857480 - data ffff8c0a71b50360/ffff8c0a7b99a800 00010000:00010000:3.0:1788521468.905065:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788521468.912231:0:13025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788521468.956702:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788521468.956710:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788521468.956732:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521468.956734:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788521468.957506:0:6764:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788521468.957511:0:6764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788521468.957522:0:6764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788521468.967835:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788521468.967843:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788521468.967861:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521468.967863:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788521468.968447:0:7964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788521468.968451:0:7964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788521468.968462:0:7964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788521469.059109:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016077 00000020:00000080:2.0:1788521469.059120:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a75d24800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788521469.061045:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01608c 00000020:00000080:2.0:1788521469.061057:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a75d20000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521469.061124:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d24800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788521469.061277:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788521469.061283:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521469.061291:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788521469.061296:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c0a45653380) has no exports 00000020:00000080:3.0:1788521469.061421:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d20000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788521469.061607:0:13025:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788521469.061615:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0162ca 00000020:00000080:2.0:1788521469.061629:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a7f669000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788521469.061633:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788521469.061636:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521469.061641:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788521469.061643:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c09413319c0) has no exports 00000020:00000080:2.0:1788521469.061648:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0162c3 00000020:00000080:2.0:1788521469.061650:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a6dc89000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788521469.061688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f669000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788521469.061696:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a6dc89000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788521469.062351:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788521469.062356:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788521469.062361:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788521469.062366:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521469.062432:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788521469.062513:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521469.062522:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521469.062529:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0161e3 00000020:00000080:2.0:1788521469.062535:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a46497000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521469.062555:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a6dc8f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788521469.062561:0:37:0:(genops.c:885:class_export_put()) final put ffff8c0a7ab92000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521469.062563:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7ab92000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788521469.062570:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788521469.062671:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788521469.062675:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521469.062679:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788521469.062681:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c0a458ecd40) has no exports 00000020:00000080:2.0:1788521469.062686:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0161dc 00000020:00000080:2.0:1788521469.062689:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0941155800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788521469.062708:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a46497000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788521469.063512:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788521469.063517:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788521469.063520:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788521469.063525:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788521469.063527:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521469.063651:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0941155800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521469.063750:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521469.063758:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521469.063811:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521469.063816:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521469.063820:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a79c72800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788521469.063834:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a79c72800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788521469.063840:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788521469.064066:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016093 00000020:00000080:2.0:1788521469.064137:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a75d21800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788521469.064439:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7c4a8000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788521469.064446:0:37:0:(genops.c:885:class_export_put()) final put ffff8c0941152000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788521469.064449:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0941152000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788521469.064453:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788521469.064600:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788521469.064605:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521469.064611:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788521469.064615:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c0a456519c0) has no exports 00000020:00000080:2.0:1788521469.064637:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521469.064641:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788521469.064645:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01609a 00000020:00000080:2.0:1788521469.064650:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a75d23000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788521469.064668:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d21800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788521469.064672:0:37:0:(genops.c:885:class_export_put()) final put ffff8c0a75d25800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788521469.064674:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d25800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788521469.064678:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788521469.065324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d23000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:2.0:1788521469.065324:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a4f90d800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788521469.065332:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a4f90d800 3 00000020:01000004:2.0:1788521469.065337:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0a4f90d800 from lustre-MDT0000 00000020:00000080:2.0:1788521469.065359:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521469.065364:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788521469.065368:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a75d26800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788521469.065371:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d26800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788521469.065377:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788521469.065410:0:13025:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788521469.065414:0:13025:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788521469.065417:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788521469.065419:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521469.065422:0:13025:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788521469.065429:0:13025:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c0a46316000 02b855e8-b82d-4a25-90ff-ed0c016d947b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521469.065434:0:13025:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c0a45650000) has exports, disconnecting them 00000020:00080000:2.0:1788521469.065438:0:13025:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c0a46316000), last request at 1788521231 00000020:00000080:2.0:1788521469.065459:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016038 00000020:00010000:2.0:1788521469.065464:0:13025:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c0a46316000: total 0 00000100:00080000:2.0:1788521469.065469:0:13025:0:(import.c:65:import_set_state_nolock()) ffff8c0a46310800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788521469.065487:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0a46316000): rc 0 00000020:00080000:2.0:1788521469.065499:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c0a45650000) has no exports 00000020:00010000:0.0:1788521469.065828:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c0a46316000: total 0 00010000:00010000:0.0:1788521469.065869:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c0a46316000, canceled 0 locks, left on hash table 8. 00000100:00100000:2.0:1788521469.065883:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c0a44f98e00:5828] 2 exiting: rc = 0 00010000:00010000:0.0:1788521469.065893:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81beb800/0x53df1cebae01658d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016586 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065909:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a821c4600/0x53df1cebae016372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae01636b expref: 8 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065917:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a4166f400/0x53df1cebae01639c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016395 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065925:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01659b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016594 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065936:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae016150 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016149 expref: 5 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065948:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea800/0x53df1cebae016348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae016341 expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065956:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a1600/0x53df1cebae016356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae01634f expref: 3 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065966:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a81bea000/0x53df1cebae016364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x53df1cebae01635d expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521469.065975:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c0a46316000, canceled 8 locks, left on hash table 0. 00000100:00100000:2.0:1788521469.065986:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c0a44f98600:5826] 1 exiting: rc = 0 00000020:00000080:0.0:1788521469.065993:0:5821:0:(genops.c:885:class_export_put()) final put ffff8c0a46316000/02b855e8-b82d-4a25-90ff-ed0c016d947b 00010000:00010000:0.0:1788521469.066005:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521469.066007:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521469.066009:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788521469.066014:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a46316000/02b855e8-b82d-4a25-90ff-ed0c016d947b for MGS 00000020:00000080:0.0:1788521469.066056:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a46310800 for MGS 00000100:00100000:3.0:1788521469.066223:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c0a45954400:5825] 0 exiting: rc = 1 00000100:00100000:2.0:1788521469.066288:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066297:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066305:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066312:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066321:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066330:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066340:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066349:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066358:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066365:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066373:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066380:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066389:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066398:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066406:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066414:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066420:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066429:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066436:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066460:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066470:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066475:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066481:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066487:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066492:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066497:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066503:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066508:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066514:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066520:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066533:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066554:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066562:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066568:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066573:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066579:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066586:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066595:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066604:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066613:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066622:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066630:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066638:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066646:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066654:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066661:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066682:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066691:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066698:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066705:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066713:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066720:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066728:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066736:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066743:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066751:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066757:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066763:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066768:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066791:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066798:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066803:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066808:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.066814:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788521469.067465:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788521469.067469:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788521469.068127:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a7f636ba0 - data ffff8c0a7039a000/ffff8c0a7acc6400 00000020:01000000:2.0:1788521469.068307:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a460f5d20 - data ffff8c0a70047a20/ffff8c0a45884400 00000020:00000080:2.0:1788521469.069109:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01601c 00000020:00000080:2.0:1788521469.069116:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a60442800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788521469.069129:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a4f90d800 from MGS, refs=2 00000020:01000004:2.0:1788521469.069132:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a4f90d800 2 00000020:01000004:2.0:1788521469.069135:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0a4f90d800 from MGS 00000020:00000080:0.0:1788521469.069146:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a60442800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788521469.069154:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521469.069160:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788521469.069162:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a60441000/MGS 00000020:00000080:2.0:1788521469.069164:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a60441000/MGS for MGS 00000020:01000000:2.0:1788521469.069169:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788521469.069220:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788521469.069225:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521469.069230:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788521469.069236:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c0a75428800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788521469.069242:0:13025:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8c0a458eb380) has exports, disconnecting them 00000020:00080000:2.0:1788521469.069247:0:13025:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c0a75428800), last request at 1788521232 00000020:00000080:2.0:1788521469.069262:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae0160e7 00000020:00080000:2.0:1788521469.069277:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0a75428800): rc 0 00000020:00000080:2.0:1788521469.069282:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a75428800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788521469.069589:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75428800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788521469.071839:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788521469.071848:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788521469.071853:0:13025:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788521469.071879:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788521469.072084:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a458fe800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788521469.072095:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788521469.072105:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788521469.072111:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a7542e000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788521469.072114:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7542e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788521469.072120:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788521469.072204:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a4f90d800 1 00000020:00000080:3.0:1788521469.072218:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01600e 00000020:00000080:3.0:1788521469.072224:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a60444000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788521469.072240:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788521469.072245:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788521469.072249:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788521469.072260:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c0a489a4d40) has no exports 00000020:00000080:0.0:1788521469.072278:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a60444000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788521469.124847:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521469.124861:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788521469.124867:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a4f90f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788521469.124872:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a4f90f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788521469.124882:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788521469.125034:0:13025:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c0a4f90f800 00000020:01000000:0.0:1788521469.125055:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788521469.125059:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521469.125063:0:13025:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521469.125068:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c0a458e8000) has no exports 00000100:00100000:3.0:1788521469.125485:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c0a4587aa00:5832] 0 exiting: rc = 1 00000100:00100000:3.0:1788521469.125588:0:6713:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c0a7f782800:6713] 3 exiting: rc = 0 00000100:00100000:2.0:1788521469.125595:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c0a458f1c00:5833] 1 exiting: rc = 0 00000100:00100000:1.0:1788521469.126881:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c0a458f0c00:5834] 2 exiting: rc = 0 00000100:00100000:0.0:1788521469.127344:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127352:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127358:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127364:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127369:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127374:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127379:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127385:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127389:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127394:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127449:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127468:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127473:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127479:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127485:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127490:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127495:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127500:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127505:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127509:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127514:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127519:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127525:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127530:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127535:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127540:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127545:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127550:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127554:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127560:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127565:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127571:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127576:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127581:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127587:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127592:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127597:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127602:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127607:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127612:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127617:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127622:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127627:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127632:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127638:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127644:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127659:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127665:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127670:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127676:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127680:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127686:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127690:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127695:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127699:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127702:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127705:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127708:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127712:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127715:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127720:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127725:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127728:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521469.127733:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.137745:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c0a458f0400:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1788521469.137846:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c0a458f0800:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1788521469.138020:0:11971:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8c0a7a898200:11971] 2 exiting: rc = 0 00000100:00100000:1.0:1788521469.138147:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138156:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138164:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138178:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138184:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138190:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138195:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138201:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138207:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138212:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138218:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138259:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138303:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138309:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138318:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138323:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138328:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138332:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138337:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138342:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138347:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138351:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138356:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138361:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138366:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138370:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138374:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138378:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138382:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138387:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138391:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138420:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138425:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138430:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138436:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138440:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138443:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138446:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138450:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138453:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138456:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138459:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138462:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138465:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138468:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138471:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138473:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138482:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138485:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138489:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138492:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138495:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138498:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138502:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138507:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138511:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138514:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138517:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138520:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138523:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138527:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138530:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138534:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138540:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.138854:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c0a68c5ce00:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788521469.138870:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c0a458f0200:5838] 1 exiting: rc = 0 00000100:00100000:1.0:1788521469.138978:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138985:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.138991:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139007:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139014:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139019:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139025:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139031:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139037:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139043:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139048:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139054:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139075:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139083:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139088:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139094:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139101:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139106:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139118:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139124:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139129:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139135:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139141:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139146:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139164:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139171:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139176:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139182:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139188:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139194:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139199:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139205:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139210:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139215:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139221:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139226:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139246:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139264:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139270:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139277:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139283:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139288:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139294:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139300:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139305:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139309:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139315:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139319:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139338:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139344:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139350:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139356:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139362:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139372:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139378:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139384:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139390:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139395:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139403:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139409:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139428:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139436:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139441:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.139447:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521469.149218:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c0a458b3400:5839] 0 exiting: rc = 1 00000100:00100000:3.0:1788521469.149298:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c0a458b3000:5840] 1 exiting: rc = 0 00000100:00100000:1.0:1788521469.149412:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149420:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149425:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149430:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149436:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149441:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149446:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149450:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149453:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149457:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149460:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149465:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149470:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149475:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149481:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149485:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149490:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149495:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149500:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149505:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149510:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149514:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149518:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149523:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149541:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149546:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149551:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149555:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149560:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149565:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149570:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149574:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149578:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149583:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149588:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149593:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149598:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149603:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149608:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149612:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149616:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149621:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149626:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149630:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149635:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149639:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149644:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149648:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149653:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149658:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149662:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149667:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149672:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149676:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149680:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149684:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149689:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149693:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149698:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149707:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149712:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149716:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149721:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.149726:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521469.150572:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c0a458a5200:5841] 0 exiting: rc = 1 00000100:00100000:2.0:1788521469.150682:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c0a60b10c00:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1788521469.150806:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150813:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150818:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150822:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150828:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150832:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150838:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150842:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150847:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150852:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.150861:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151248:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151271:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151276:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151281:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151286:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151291:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151296:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151302:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151306:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151311:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151316:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151321:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151326:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151330:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151335:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151340:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151345:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151349:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151354:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151369:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151373:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151378:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151382:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151386:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151474:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151482:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151487:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151492:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151496:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151501:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151506:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151511:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151516:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151521:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151526:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151531:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151535:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151540:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151545:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151550:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151555:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151560:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151565:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151570:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151575:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151580:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151585:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151590:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151594:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151598:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151603:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151607:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151612:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.151952:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c0a44f99e00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1788521469.152058:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c0a458a4c00:5843] 0 exiting: rc = 1 00000100:00100000:1.0:1788521469.152101:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152108:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152113:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152119:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152123:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152129:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152134:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152139:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152144:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152148:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152154:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152159:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152163:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152169:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152174:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152179:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152183:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152188:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152193:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152198:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152203:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152208:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152213:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152218:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152223:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152228:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152232:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152237:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152241:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152247:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152312:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152318:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152324:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152328:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152339:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152344:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152348:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152353:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152357:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152362:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152366:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152371:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152375:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152380:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152385:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152390:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152395:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152400:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152405:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152410:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152415:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152482:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152487:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152492:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152498:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152502:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152507:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152512:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152517:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152523:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152528:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152556:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152563:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.152567:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.153132:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c0a458a1600:5846] 1 exiting: rc = 0 00000100:00100000:1.0:1788521469.153966:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c0a68c5fe00:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1788521469.155444:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c0a45285000:5847] 2 exiting: rc = 0 00000100:00100000:1.0:1788521469.155558:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155564:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155568:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155580:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155584:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155588:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155598:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155603:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155606:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155610:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155614:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155618:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155622:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155626:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155630:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155634:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155637:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155641:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155645:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155648:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155652:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155656:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155660:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155663:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155667:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155672:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155675:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155679:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155682:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155687:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155699:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155703:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155706:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155710:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155713:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155718:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155721:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155725:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155732:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155736:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155740:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155744:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155747:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155751:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155755:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155758:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155762:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155765:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155769:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155943:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155952:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155959:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155965:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155971:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155991:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.155998:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156004:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156010:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156016:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156022:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156029:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156035:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156041:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788521469.156055:0:13025:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788521469.160295:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521469.160312:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788521469.160318:0:13025:0:(genops.c:885:class_export_put()) final put ffff8c0a46306800/MDS_uuid 00000020:00000080:0.0:1788521469.160322:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a46306800/MDS_uuid for MDS 00000020:01000000:0.0:1788521469.160331:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788521469.160473:0:13025:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788521469.930205:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521470.957811:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521471.983698:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788521472.407733:0:13180:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788521472.423200:0:13180:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788521472.423264:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.423280:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.423305:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.423312:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.423339:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788521472.423344:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788521472.423364:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521472.423368:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788521472.423374:0:13180:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788521472.423380:0:13180:0:(import.c:65:import_set_state_nolock()) ffff8c0a7f66f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788521472.423385:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521472.423387:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788521472.423390:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788521472.424210:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424223:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424242:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424248:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424274:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788521472.424292:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424299:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424306:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424312:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521472.424319:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788521472.424322:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788521472.424342:0:13180:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788521472.424346:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788521472.424350:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521472.424355:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521472.424359:0:13180:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c0a7b9f3380) has no exports 00000020:00080000:0.0:1788521472.424384:0:13180:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c0a7b9f3380) has no exports 00000020:01000000:0.0:1788521472.425942:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a7f6360c0 - data ffff8c0a71b9eca8/ffff8c0a7f5f9c00 00000020:01000000:0.0:1788521472.426099:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a7a8bcae0 - data ffff8c0a70058438/ffff8c0a7f666c00 00010000:00010000:1.0:1788521472.426422:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788521472.426432:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426443:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0a00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521472.426448:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426474:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521472.426481:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521472.426487:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521472.426490:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788521472.426494:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788521472.426532:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426538:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521472.426565:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426572:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0a00/0x53df1cebae01635d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016364 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426584:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521472.426587:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426593:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521472.426595:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426602:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521472.426619:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521472.426624:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521472.426626:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788521472.426628:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788521472.426642:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426648:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521472.426654:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426660:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1400/0x53df1cebae01636b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae016372 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426668:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521472.426672:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426677:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a82045600 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521472.426680:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426685:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521472.426691:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521472.426705:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788521472.426707:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788521472.426709:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788521472.426725:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426731:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521472.426749:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426756:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a82045600/0x53df1cebae016594 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x53df1cebae01659b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521472.426766:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521472.426768:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521472.426770:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521472.426804:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368148480:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521472.426873:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521472.426990:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521472.426997:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368148608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521472.427020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521472.427046:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788521472.427053:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368148736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521472.427075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521472.427110:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368148480 00000100:00100000:1.0:1788521472.427116:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368148480 00000100:00100000:1.0:1788521472.427151:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368148608 00000100:00100000:1.0:1788521472.427153:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368148608 00000100:00100000:1.0:1788521472.427171:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368148736 00000100:00100000:1.0:1788521472.427173:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368148736 00000100:00100000:1.0:1788521472.427183:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521472.427190:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1875400368148480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788521472.427196:0:5818:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521472 with bad export cookie 6043581023516713016 00000100:00100000:3.0:1788521472.428498:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521472.428509:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1875400368148608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788521472.428516:0:5819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521472 with bad export cookie 6043581023516713016 00000100:00100000:3.0:1788521472.428592:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1875400368148608:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (1570us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788521472.428599:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788521472.428621:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788521472.428625:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60aea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1875400368148736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788521472.428629:0:5819:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788521472 with bad export cookie 6043581023516713016 00000100:00100000:3.0:1788521472.428659:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60aea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3301:x1875400368148736:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1583us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788521472.428665:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788521472.428699:0:3301:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788521472.428704:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8c0a46312800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788521472.428708:0:3301:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788521472.428787:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788521472.429148:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788521472.437306:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3302:x1875400368148480:12345-0@lo:103:ldlm_bl.0 Request processed in 10104us (10421us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788521472.437321:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788521472.445710:0:3301:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.148@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788521472.445730:0:3301:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788521472.445821:0:3301:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0a7f31ed80 x1875400368148480/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521488 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521472.445838:0:3301:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0a7f31d880 x1875400368148608/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521488 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521472.445846:0:3301:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0a7f31e300 x1875400368148736/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788521488 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788521472.445861:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788521472.445863:0:3301:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788521472.445864:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788521472.445925:0:3302:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0a46312800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:3.0:1788521472.445926:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8c0a46312800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521472.445931:0:3301:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 152 00000100:00080000:3.0:1788521472.445942:0:3301:0:(import.c:665:import_select_connection()) MGC192.168.203.148@tcp: import ffff8c0a46312800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521472.445953:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368148480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521472.445970:0:3301:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a6ddcaa00 x1875400368148864/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521472.445977:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:02b855e8-b82d-4a25-90ff-ed0c016d947b:3302:1875400368148608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521472.446025:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02b855e8-b82d-4a25-90ff-ed0c016d947b:3299:1875400368148864:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788521472.446070:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875400368148864 offset 0 length 520: 4 00000100:00100000:3.0:1788521472.446137:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:02b855e8-b82d-4a25-90ff-ed0c016d947b:3301:1875400368148736:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1788521472.466526:0:13180:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788521472.531906:0:13180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01616c 00000020:00000080:0.0:1788521472.531917:0:13180:0:(genops.c:885:class_export_put()) final put ffff8c0a7f3b5000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788521472.531927:0:13180:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a75d22000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788521472.531931:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a75d22000 2 00000020:01000004:0.0:1788521472.531935:0:13180:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0a75d22000 from lustre-OST0000 00000020:00000080:0.0:1788521472.531959:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521472.531982:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788521472.531985:0:13180:0:(genops.c:885:class_export_put()) final put ffff8c0a7c4d0000/lustre-OST0000_UUID 00000020:00000080:0.0:1788521472.531988:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7c4d0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788521472.531994:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788521472.532037:0:13180:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788521472.532041:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788521472.532044:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521472.532049:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788521472.532055:0:13180:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c0a7f66d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788521472.532060:0:13180:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8c0a489a0000) has exports, disconnecting them 00000020:00080000:0.0:1788521472.532065:0:13180:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c0a7f66d800), last request at 1788521249 00000020:00000080:0.0:1788521472.532068:0:13180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016196 00000020:00080000:0.0:1788521472.532078:0:13180:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0a7f66d800): rc 0 00000020:00000080:0.0:1788521472.532082:0:13180:0:(genops.c:885:class_export_put()) final put ffff8c0a7f66d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788521472.532175:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f3b5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788521472.532185:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f66d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788521472.539770:0:13180:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788521472.539811:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788521472.539816:0:13180:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788521472.539823:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788521472.539858:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7f66f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788521472.540046:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788521472.540056:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788521472.540061:0:13180:0:(genops.c:885:class_export_put()) final put ffff8c0a7f668000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788521472.540065:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f668000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788521472.540072:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788521472.540134:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a75d22000 1 00000020:00000080:1.0:1788521472.540140:0:13180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016126 00000020:00000080:1.0:1788521472.540146:0:13180:0:(genops.c:885:class_export_put()) final put ffff8c0a75912000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788521472.540154:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788521472.540163:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75912000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788521472.540172:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788521472.540177:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788521472.540180:0:13180:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c0a7b9f19c0) has no exports 00000020:00000080:2.0:1788521472.558591:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521472.558606:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788521472.558611:0:13180:0:(genops.c:885:class_export_put()) final put ffff8c0a75d20800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788521472.558616:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75d20800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788521472.558624:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788521472.558789:0:13180:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c0a75d27000 00000020:02000400:2.0:1788521472.558834:0:13180:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788521473.003768:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521473.128900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 02b855e8-b82d-4a25-90ff-ed0c016d947b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788521473.128911:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 02b855e8-b82d-4a25-90ff-ed0c016d947b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521473.128914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788521473.128918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788521473.128921:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab95800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521473.128930:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 389 00000100:00080000:3.0:1788521473.128936:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788521473.128944:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0a7ab95800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1788521473.128985:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a6ddc9500 x1875400368148992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521473.129144:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368148992:0@lo:38:kworker.0 00000400:00000100:2.0:1788521473.129198:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875400368148992 offset 0 length 520: 4 00010000:00010000:1.0:1788521474.028165:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521475.059360:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788521475.954671:0:13329:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788521475.970199:0:13329:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788521475.970285:0:13329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.970299:0:13329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.970306:0:13329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.970313:0:13329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.970430:0:13329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788521475.970447:0:13329:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788521475.970471:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521475.970482:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0a6ddc9500 x1875400368148992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788521488 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521475.970502:0:13329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788521475.970508:0:13329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788521475.970514:0:13329:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab95800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788521475.970518:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788521475.970522:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0a6ddc9500 x1875400368148992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788521488 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521475.970529:0:13329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788521475.970532:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:2.0:1788521475.970604:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368148992:0@lo:38:kworker.0 00010000:00010000:0.0:1788521475.971940:0:13329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.971955:0:13329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.971963:0:13329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.972039:0:13329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972397:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521475.972405:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972413:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166e600 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521475.972417:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972426:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521475.972434:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521475.972440:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521475.972442:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788521475.972445:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788521475.972457:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c0a46312800 00010000:00010000:1.0:1788521475.972461:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972468:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a4166e600/0x53df1cebae016341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae016348 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972478:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521475.972481:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972486:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0e00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521475.972501:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972507:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521475.972513:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521475.972519:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788521475.972521:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788521475.972526:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c0a46312800 00010000:00010000:1.0:1788521475.972529:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972536:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521475.972537:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521475.972539:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521475.972659:0:13329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788521475.972665:0:13329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0e00/0x53df1cebae01634f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae016356 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.972686:0:13329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.972702:0:13329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.972708:0:13329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521475.972714:0:13329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972884:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521475.972889:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972895:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ba00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521475.972898:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.972905:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521475.972911:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521475.973050:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788521475.973052:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788521475.973059:0:5821:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c0a46312800 00010000:00010000:1.0:1788521475.973062:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521475.973069:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521475.973071:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521475.973072:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521475.973118:0:13329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788521475.973122:0:13329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ba00/0x53df1cebae016586 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae01658d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521475.973135:0:13329:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788521475.973140:0:13329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788521475.973142:0:13329:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788521475.973166:0:13329:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788521475.973170:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788521475.973176:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521475.973181:0:13329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788521475.973185:0:13329:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c0a75c499c0) has no exports 00000020:00080000:0.0:1788521475.973224:0:13329:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c0a75c499c0) has no exports 00010000:00010000:1.0:1788521475.973398:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788521475.976196:0:13329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a7a8bcf60 - data ffff8c0a7002a5e8/ffff8c0a75ca1c00 00000020:01000000:0.0:1788521475.976431:0:13329:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c0a7f636300 - data ffff8c0a7005daf8/ffff8c0a81dd2c00 00100000:10000000:1.0:1788521475.996316:0:13329:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788521476.018699:0:13329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016237 00000020:00000080:0.0:1788521476.018709:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a75c56800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788521476.018724:0:13329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a7f66c000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788521476.018727:0:13329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a7f66c000 2 00000020:01000004:0.0:1788521476.018731:0:13329:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0a7f66c000 from lustre-OST0001 00000020:00000080:0.0:1788521476.018766:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521476.018807:0:13329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788521476.018811:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a7b9e3800/lustre-OST0001_UUID 00000020:00000080:0.0:1788521476.018814:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7b9e3800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788521476.018823:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788521476.018900:0:13329:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 02b855e8-b82d-4a25-90ff-ed0c016d947b->MGS 00010000:00010000:0.0:1788521476.018916:0:13329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521476.018927:0:13329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521476.018934:0:13329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788521476.018936:0:13329:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788521476.018939:0:13329:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788521476.018952:0:13329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c0a46312800 00010000:00010000:0.0:1788521476.018956:0:13329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a4166fa00/0x53df1cebae016149 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae016150 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521476.018984:0:13329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521476.018991:0:13329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521476.018996:0:13329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788521476.018999:0:13329:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788521476.019001:0:13329:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788521476.019010:0:13329:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c0a46312800 00010000:00010000:0.0:1788521476.019013:0:13329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a81bebc00/0x53df1cebae016395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x53df1cebae01639c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788521476.019040:0:13329:0:(import.c:65:import_set_state_nolock()) ffff8c0a46312800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788521476.019044:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788521476.019046:0:13329:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788521476.019048:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788521476.019051:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788521476.019061:0:13329:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0a6ddcaa00 x1875400368148864/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788521482 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788521476.019071:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788521476.019074:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:2.0:1788521476.019274:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:02b855e8-b82d-4a25-90ff-ed0c016d947b:3299:1875400368148864:0@lo:250:ptlrpcd_00_01.0 00000020:00000080:3.0:1788521476.019540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75c56800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1788521476.019583:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788521476.019599:0:13329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae01602a 00000020:00000080:0.0:1788521476.019605:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a46300000/02b855e8-b82d-4a25-90ff-ed0c016d947b 00000020:01000000:0.0:1788521476.019623:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.148@tcp (flags='') 00000020:00000080:0.0:1788521476.019628:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521476.019633:0:13329:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788521476.019636:0:13329:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c0a489a19c0) has no exports 10000000:01000000:2.0:1788521476.019698:0:5830:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788521476.019830:0:13329:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.148@tcp: client import never connected 00000100:00080000:0.0:1788521476.019834:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788521476.019836:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788521476.019838:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788521476.019840:0:13329:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788521476.019870:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788521476.019875:0:13329:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.148@tcp (uuid 02b855e8-b82d-4a25-90ff-ed0c016d947b) 00000020:01000000:0.0:1788521476.019880:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788521476.019883:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788521476.019887:0:13329:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788521476.019891:0:13329:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c0a7ab93800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788521476.019896:0:13329:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8c0a458e99c0) has exports, disconnecting them 00000020:00080000:0.0:1788521476.019900:0:13329:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c0a7ab93800), last request at 1788521270 00000020:00000080:0.0:1788521476.019904:0:13329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016261 00000020:00080000:0.0:1788521476.019933:0:13329:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0a7ab93800): rc 0 00000020:00000080:0.0:1788521476.019937:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a7ab93800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788521476.020877:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a46300000/02b855e8-b82d-4a25-90ff-ed0c016d947b for MGC192.168.203.148@tcp 00000020:00000080:3.0:1788521476.020888:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a46312800 for MGC192.168.203.148@tcp 00000020:00000080:3.0:1788521476.020895:0:37:0:(genops.c:885:class_export_put()) final put ffff8c0a46317800/02b855e8-b82d-4a25-90ff-ed0c016d947b 00000020:00000080:3.0:1788521476.020897:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a46317800/02b855e8-b82d-4a25-90ff-ed0c016d947b for MGC192.168.203.148@tcp 00000020:01000000:3.0:1788521476.020901:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.148@tcp (02b855e8-b82d-4a25-90ff-ed0c016d947b) 00000020:00000080:3.0:1788521476.021137:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7ab93800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788521476.027862:0:13329:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788521476.027870:0:13329:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788521476.027874:0:13329:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788521476.027881:0:13329:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788521476.027988:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c0a7ab95800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788521476.033855:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788521476.034168:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788521476.034348:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c0a4f974c00:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1788521476.034482:0:8463:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8c0a45709800:8463] 2 exiting: rc = 0 00000100:00100000:0.0:1788521476.034546:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c0a4625a800:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1788521476.034630:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.035005:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c0a48288800:5819] 1 exiting: rc = 0 00000100:00100000:0.0:1788521476.035162:0:8520:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c0a75c17000:8520] 3 exiting: rc = 0 00000100:00100000:1.0:1788521476.035497:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c0a60b11e00:5820] 2 exiting: rc = 0 00000100:00100000:1.0:1788521476.035648:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c0a48289c00:5818] 0 exiting: rc = 1 00000100:00100000:2.0:1788521476.036103:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036110:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036116:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036121:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036127:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036133:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036138:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036155:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036163:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036169:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036178:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036185:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036190:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036195:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036200:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036231:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036237:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036244:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036249:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036254:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036259:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036264:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036268:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036274:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036279:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036284:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036289:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036293:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036298:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036304:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036309:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036314:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036319:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036390:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036397:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036402:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036407:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036412:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036417:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036422:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036427:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036431:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036444:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036449:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036454:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036459:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036463:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036468:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036474:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036479:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036484:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036489:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036494:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036499:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036505:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036510:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036515:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036520:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036526:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036531:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036537:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036541:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036546:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.036550:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788521476.038506:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521476.038518:0:13329:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788521476.038524:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a6dc8d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788521476.038528:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a6dc8d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788521476.038537:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788521476.038578:0:13329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a7f66c000 1 00000020:00000080:2.0:1788521476.038584:0:13329:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x53df1cebae016206 00000020:00000080:2.0:1788521476.038590:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a7c4d6800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788521476.038616:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788521476.038621:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521476.038626:0:13329:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788521476.038630:0:13329:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8c0a489a3380) has no exports 00000020:00000080:3.0:1788521476.039114:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7c4d6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788521476.055221:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521476.055236:0:13329:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788521476.055242:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a7f668800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788521476.055247:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a7f668800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788521476.055254:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788521476.055458:0:13329:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8c0a7f66a800 00000020:01000000:2.0:1788521476.055479:0:13329:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788521476.055483:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788521476.055487:0:13329:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788521476.055491:0:13329:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c0a7b9f0000) has no exports 00000020:00000080:2.0:1788521476.055516:0:13329:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788521476.055522:0:13329:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788521476.055525:0:13329:0:(genops.c:885:class_export_put()) final put ffff8c0a75915000/OSS_uuid 00000020:00000080:2.0:1788521476.055528:0:13329:0:(genops.c:844:class_export_destroy()) destroying export ffff8c0a75915000/OSS_uuid for OSS 00000020:01000000:2.0:1788521476.055532:0:13329:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788521476.056453:0:8219:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c0a81fd4200:8219] 3 exiting: rc = 0 00000100:00080000:3.0:1788521476.056586:0:5829:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788521476.057231:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c0a5808f400:6693] 2 exiting: rc = 0 00000100:00100000:2.0:1788521476.057289:0:12535:0:(service.c:3183:ptlrpc_main()) ll_ost00_005: service thread [ffff8c0a75443200:12535] 5 exiting: rc = 0 00000100:00100000:2.0:1788521476.057914:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c0a5808fa00:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1788521476.058087:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c0a46537000:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1788521476.058147:0:12534:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8c0a7af80e00:12534] 4 exiting: rc = 0 00000100:00100000:3.0:1788521476.061496:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061507:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061514:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061521:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061526:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061531:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061536:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061541:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061546:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061552:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061557:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061563:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061568:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061573:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061577:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061582:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061662:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061667:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061672:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061746:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061754:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061760:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061765:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061873:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061881:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061886:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061892:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061898:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061902:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061907:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061912:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.061917:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062234:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062243:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062248:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062253:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062258:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062263:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062268:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062273:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062277:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062283:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062291:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062298:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062304:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062311:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062316:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062407:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062419:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062426:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062435:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062450:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062456:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062461:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062466:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062471:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062478:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062483:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062489:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062493:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062498:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062502:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062507:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.062512:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521476.064730:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c0a5808f200:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1788521476.065075:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c0a5808fc00:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1788521476.065354:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065363:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065368:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065373:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065377:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065382:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065388:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065393:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065397:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065403:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065408:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065413:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065418:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065424:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065428:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065433:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065438:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065442:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065447:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065452:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065457:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065463:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065481:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065487:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065491:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065496:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065501:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065507:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065514:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065519:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065523:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065529:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065534:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065539:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065544:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065550:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065555:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065560:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065583:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065590:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065767:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065804:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065810:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065815:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065819:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065824:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065829:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065833:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065838:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065843:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065848:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065853:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065858:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065863:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065870:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065876:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065883:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065896:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065901:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065906:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065911:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065916:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.065921:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.066135:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.067729:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c0a7a8ba200:6698] 2 exiting: rc = 0 00000100:00100000:2.0:1788521476.067944:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c0a8189e000:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1788521476.068408:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c0a8189ee00:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1788521476.068574:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068582:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068589:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068606:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068612:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068618:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068624:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068629:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068649:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068655:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068662:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068669:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068674:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068804:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068809:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068815:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068820:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068826:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068832:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068837:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068843:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.068848:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069047:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069052:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069058:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069064:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069087:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069093:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069099:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069104:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069110:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069116:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069121:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069127:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069133:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069139:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069144:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069150:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069155:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069161:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069167:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069173:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069179:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069193:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069200:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069217:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069223:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069229:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069235:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069241:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069262:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069269:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069275:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069281:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069287:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069292:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069298:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069304:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069309:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069314:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069320:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069325:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069331:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.069336:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521476.079761:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c0a7af0f800:6700] 1 exiting: rc = 0 00000100:00100000:3.0:1788521476.080117:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c0a7af0f200:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1788521476.081109:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081117:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081122:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081127:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081132:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081238:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081244:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081250:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081255:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081260:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081265:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081270:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081276:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081282:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081287:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081331:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081338:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081343:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081348:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081354:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081359:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081364:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081370:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081375:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081381:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081386:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081392:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081414:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081419:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081425:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081430:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081436:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081441:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081447:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081452:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081457:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081463:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081469:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081474:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081480:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081486:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081491:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081497:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081502:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081508:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081514:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081520:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081525:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081530:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081535:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081540:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081545:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081549:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081554:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081559:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081564:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081569:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081573:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081578:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081583:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081588:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081605:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081620:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788521476.081625:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788521476.083495:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c0a7af0e800:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1788521476.084005:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c0a5808fe00:6702] 1 exiting: rc = 0 00000100:00100000:2.0:1788521476.084237:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084246:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084252:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084259:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084265:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084271:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084278:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084284:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084303:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084310:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084315:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084321:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084328:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084333:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084347:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084353:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084359:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084365:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084371:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084376:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084398:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084404:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084409:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084416:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084423:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084429:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084434:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084440:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084446:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084453:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084460:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084467:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084488:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084495:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084501:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084508:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084514:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084519:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084526:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084532:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084537:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084543:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084549:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084555:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084576:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084582:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084588:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084608:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084614:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084628:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084637:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084643:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084649:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.084655:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085094:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085102:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085126:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085136:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085142:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085149:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085155:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085161:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085166:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788521476.085172:0:13329:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788521476.096367:0:13329:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788521496.122098:0:13942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788521504.842702:0:14413:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788521504.842707:0:14413:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788521504.842828:0:14413:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c09434dd000 00000020:01000004:2.0:1788521504.842844:0:14413:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788521504.842852:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788521504.842866:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c0a45650000) 00000020:00000080:2.0:1788521504.842878:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788521504.856318:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788521504.858725:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788521504.859328:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:2.0:1788521504.859427:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:2.0:1788521504.859516:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 512: rc = 0 00100000:10000000:2.0:1788521504.859866:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788521504.859935:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 512: rc = 0 00100000:10000000:2.0:1788521504.860038:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 512: rc = 0 00100000:10000000:2.0:1788521504.860134:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 512: rc = 0 00100000:10000000:2.0:1788521504.861062:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 514: rc = 0 00100000:10000000:2.0:1788521504.863527:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 453: rc = 0 00100000:10000000:2.0:1788521504.863738:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 453: rc = 0 00100000:10000000:2.0:1788521504.864318:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 461: rc = 0 00100000:10000000:2.0:1788521504.864862:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 461: rc = 0 00100000:10000000:2.0:1788521504.865121:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 461: rc = 0 00100000:10000000:2.0:1788521504.865360:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 461: rc = 0 00100000:10000000:2.0:1788521504.865714:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 461: rc = 0 00100000:10000000:2.0:1788521504.866088:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 461: rc = 0 00100000:10000000:2.0:1788521504.866341:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 461: rc = 0 00100000:10000000:2.0:1788521504.866697:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 461: rc = 0 00100000:10000000:2.0:1788521504.867048:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 461: rc = 0 00100000:10000000:2.0:1788521504.867292:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 461: rc = 0 00100000:10000000:2.0:1788521504.867654:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 461: rc = 0 00100000:10000000:2.0:1788521504.868043:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 461: rc = 0 00100000:10000000:2.0:1788521504.868443:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 483: rc = 0 00100000:10000000:2.0:1788521504.868894:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 483: rc = 0 00100000:10000000:2.0:1788521504.869217:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 483: rc = 0 00100000:10000000:2.0:1788521504.869504:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 483: rc = 0 00100000:10000000:2.0:1788521504.869992:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 483: rc = 0 00100000:10000000:2.0:1788521504.870325:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 483: rc = 0 00100000:10000000:2.0:1788521504.870678:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 483: rc = 0 00100000:10000000:2.0:1788521504.871076:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 483: rc = 0 00100000:10000000:2.0:1788521504.871324:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 483: rc = 0 00100000:10000000:2.0:1788521504.871918:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 483: rc = 0 00100000:10000000:2.0:1788521504.872197:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 483: rc = 0 00100000:10000000:2.0:1788521504.872386:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 483: rc = 0 00100000:10000000:2.0:1788521504.872722:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 483: rc = 0 00100000:10000000:2.0:1788521504.873305:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 483: rc = 0 00100000:10000000:2.0:1788521504.873658:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 483: rc = 0 00100000:10000000:2.0:1788521504.873937:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 483: rc = 0 00100000:10000000:2.0:1788521504.874452:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 483: rc = 0 00100000:10000000:2.0:1788521504.875510:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 483: rc = 0 00100000:10000000:2.0:1788521504.875923:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 483: rc = 0 00100000:10000000:2.0:1788521504.876354:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 483: rc = 0 00100000:10000000:2.0:1788521504.876619:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 483: rc = 0 00100000:10000000:2.0:1788521504.876896:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 483: rc = 0 00100000:10000000:2.0:1788521504.877169:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 483: rc = 0 00100000:10000000:2.0:1788521504.877401:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 483: rc = 0 00100000:10000000:2.0:1788521504.877632:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 483: rc = 0 00100000:10000000:2.0:1788521504.877913:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 483: rc = 0 00100000:10000000:2.0:1788521504.878167:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 483: rc = 0 00100000:10000000:2.0:1788521504.878428:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 483: rc = 0 00100000:10000000:2.0:1788521504.878669:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 483: rc = 0 00100000:10000000:2.0:1788521504.878945:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 483: rc = 0 00100000:10000000:2.0:1788521504.881931:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 483: rc = 0 00100000:10000000:2.0:1788521504.882276:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 483: rc = 0 00100000:10000000:2.0:1788521504.882768:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 474: rc = 0 00100000:10000000:2.0:1788521504.883449:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788521504.883735:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 456: rc = 0 00100000:10000000:2.0:1788521504.883994:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788521504.884133:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 456: rc = 0 00100000:10000000:2.0:1788521504.884312:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788521504.884384:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 456: rc = 0 00100000:10000000:2.0:1788521504.885135:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788521504.885209:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 454: rc = 0 00100000:10000000:2.0:1788521504.885391:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788521504.885461:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 454: rc = 0 00100000:10000000:2.0:1788521504.885751:0:14413:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788521504.885934:0:14413:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 454: rc = 0 00000020:00000080:2.0:1788521504.886270:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788521504.886278:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788521504.886287:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae01732b 00000020:01000004:2.0:1788521504.886296:0:14413:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788521504.886301:0:14413:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788521504.886306:0:14413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c09434dd000 from MGS 00000020:01000004:2.0:1788521504.886309:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788521504.886319:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c0a45654d40) 00000020:00000080:2.0:1788521504.886329:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788521504.886376:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c09434dd000 from MGS, refs=2 00080000:01000000:2.0:1788521504.886380:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788521504.886385:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae017339 00000100:00100000:2.0:1788521504.886472:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788521504.886705:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788521504.886712:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788521504.887350:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788521504.887357:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788521504.888176:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521504.888330:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788521504.888336:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788521504.889198:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788521504.889205:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788521504.889506:0:14413:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788521504.889512:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788521504.890348:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521504.890352:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521504.890354:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521504.890861:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521504.890864:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521504.890865:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521504.891389:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788521504.900678:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788521504.907226:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788521504.907244:0:14413:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788521504.907247:0:14413:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788521504.908912:0:14423:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788521504.909068:0:14413:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788521504.909162:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788521504.909829:0:14413:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788521504.910342:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521504.910500:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788521504.910506:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788521504.913511:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788521504.913525:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788521504.913936:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788521504.913943:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788521504.914867:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788521504.914887:0:14413:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.148@tcp' 00000020:01000004:0.0:1788521504.914888:0:14413:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788521504.914915:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.148@tcp (typ=mgc) 00000020:00000080:0.0:1788521504.914927:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.148@tcp (ffff8c0941330000) 00000020:00000080:0.0:1788521504.914942:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788521504.915124:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a6dc8b000@MGC192.168.203.148@tcp: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1788521504.915266:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.148@tcp-0 is initialized 00000040:01000000:0.0:1788521504.915272:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788521504.915416:0:14428:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788521504.917973:0:14429:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788521504.918108:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.148@tcp (uuid b2a102a8-0149-48eb-bff7-ec9f03a1ca5a) 00000020:00000080:0.0:1788521504.918130:0:14413:0:(genops.c:1385:class_connect()) connect: client b2a102a8-0149-48eb-bff7-ec9f03a1ca5a, cookie 0x53df1cebae017347 00000100:00080000:0.0:1788521504.918150:0:14413:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521504.918157:0:14413:0:(import.c:665:import_select_connection()) MGC192.168.203.148@tcp: import ffff8c0a6dc8b000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521504.918193:0:14413:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a75b0f800 x1875400368149120/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521504.918220:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import b2a102a8-0149-48eb-bff7-ec9f03a1ca5a->MGS 00000020:01000004:0.0:1788521504.918243:0:14413:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788521504.918248:0:14413:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788521504.918263:0:14413:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c0941333380) 00000020:00000080:0.0:1788521504.918275:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788521504.918410:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3299:1875400368149120:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788521504.918474:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521504.922524:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149120 00000100:00100000:3.0:1788521504.922535:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149120 00000100:00100000:3.0:1788521504.923143:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521504.923154:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1875400368149120:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788521504.923180:0:14424:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b2a102a8-0149-48eb-bff7-ec9f03a1ca5a@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:3.0:1788521504.923208:0:14424:0:(genops.c:1385:class_connect()) connect: client b2a102a8-0149-48eb-bff7-ec9f03a1ca5a, cookie 0x53df1cebae017355 00000100:00080000:3.0:1788521504.923332:0:14424:0:(import.c:65:import_set_state_nolock()) ffff8c0a4f903000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521504.923423:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+5:3299:x1875400368149120:12345-0@lo:250:mount.lustre.0 Request processed in 269us (4948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521504.923431:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521504.924142:0:3299:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788521504.924153:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.148@tcp: connect to target with instance 0 00000100:00080000:2.0:1788521504.924161:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788521504.924166:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788521504.924170:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a6dc8b000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788521504.924172:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788521504.924187:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788521504.924193:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3299:1875400368149120:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788521504.932760:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521504.932965:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521504.932970:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788521504.934662:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521504.934672:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788521504.935172:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521504.935179:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788521504.936002:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521504.936231:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788521504.936237:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788521504.937202:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788521504.937209:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788521504.976674:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521504.976959:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788521504.976966:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788521504.978580:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788521504.978594:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788521504.979422:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521504.979691:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521504.979697:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788521504.980386:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788521504.980393:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788521504.981395:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521504.981648:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521504.981654:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788521504.982709:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788521504.982719:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788521504.987448:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788521504.987757:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788521504.987764:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788521504.988794:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788521504.988803:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788521505.016111:0:14413:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521505.016714:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521505.016722:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788521505.019681:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521505.019697:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788521505.021433:0:14413:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788521505.021446:0:14413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788521505.023348:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788521505.023373:0:14413:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788521505.023379:0:14413:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788521505.023512:0:14413:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788521505.023624:0:14413:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788521505.023628:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788521505.023630:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521505.023631:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521505.023633:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521505.023634:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521505.023635:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521505.023637:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521505.023638:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521505.023640:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521505.023641:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788521505.023644:0:14413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788521505.023646:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788521505.023647:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521505.023648:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521505.023649:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521505.023651:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521505.023652:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521505.023653:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521505.023654:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521505.023655:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521505.023656:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788521505.023690:0:14413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788521505.023711:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149248:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521505.024017:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.024187:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a507de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521505.024517:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149248 00000100:00100000:3.0:1788521505.024525:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149248 00000100:00100000:3.0:1788521505.024678:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521505.024690:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+5:14413:x1875400368149248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788521505.024743:0:14427:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788521505.024746:0:14427:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788521505.024749:0:14427:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788521505.025225:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788521505.025696:0:14427:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788521505.027395:0:14448:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788521505.027402:0:14448:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788521505.027405:0:14448:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788521505.027439:0:14448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788521505.027706:0:14427:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788521505.027716:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788521505.034850:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+5:14413:x1875400368149248:12345-0@lo:253:mount.lustre.0 Request processed in 10155us (10825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521505.034882:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521505.035078:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149248:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788521505.035093:0:14413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788521505.035096:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521505.035097:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788521505.035099:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521505.035100:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521505.035101:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521505.035102:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521505.035103:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788521505.035104:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788521505.035106:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521505.035107:0:14413:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788521505.035302:0:14413:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c09434dd000 from lustre-MDT0000 10000000:01000000:1.0:1788521505.035326:0:14413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788521505.035329:0:14413:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788521505.035334:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c0941330000 10000000:01000000:1.0:1788521505.035338:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521505.035345:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0941330000 from 1 10000000:01000000:1.0:1788521505.035348:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788521505.035385:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.035396:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.035406:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521505.035433:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521505.035471:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.035510:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a507de480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521505.035658:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149376 00000100:00100000:3.0:1788521505.035665:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149376 00000100:00100000:3.0:1788521505.035756:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521505.035765:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+5:14413:x1875400368149376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521505.035808:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521505.035823:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40031800/0x53df1cebae017363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01735c expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.035845:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40031800/0x53df1cebae017363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01735c expref: 6 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.035855:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40031800/0x53df1cebae017363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01735c expref: 6 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.035864:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031800, rc 0) 00000100:00100000:3.0:1788521505.035906:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+6:14413:x1875400368149376:12345-0@lo:101:mount.lustre.0 Request processed in 143us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521505.035913:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521505.035979:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521505.035992:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.036001:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521505.036059:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521505.036084:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.036553:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a507de480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521505.036646:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149504 00000100:00100000:0.0:1788521505.036652:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149504 00000100:00100000:0.0:1788521505.036681:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521505.036689:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+6:14413:x1875400368149504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521505.037186:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+6:14413:x1875400368149504:12345-0@lo:501:mount.lustre.0 Request processed in 496us (1100us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521505.037197:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521505.037414:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149504:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788521505.037452:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788521505.037468:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.037478:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521505.037487:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c09434dd000 10000000:01000000:0.0:1788521505.037503:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788521505.037508:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c09434dd000 10000000:01000000:0.0:1788521505.037511:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788521505.037514:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8c09434dd000 from 1 10000000:01000000:0.0:1788521505.037516:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788521505.037542:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.037550:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.037559:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521505.037575:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521505.037607:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521505.037626:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521505.037687:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149632 00000100:00100000:3.0:1788521505.037693:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149632 00000100:00100000:3.0:1788521505.037718:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521505.037725:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+6:14413:x1875400368149632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521505.037734:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521505.037746:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030200/0x53df1cebae017371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01736a expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.037765:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030200/0x53df1cebae017371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01736a expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.037799:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030200/0x53df1cebae017371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01736a expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.037807:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030200, rc 0) 00000100:00100000:3.0:1788521505.037837:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+7:14413:x1875400368149632:12345-0@lo:101:mount.lustre.0 Request processed in 112us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521505.037843:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521505.037923:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521505.037935:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017371 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.037954:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017371 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521505.037967:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788521505.037982:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017371 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.037989:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6ea00/0x53df1cebae01736a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017371 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521505.037994:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788521505.037997:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788521505.038001:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c09434dd000 10000000:01000000:0.0:1788521505.038021:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788521505.038024:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788521505.038026:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788521505.038040:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.038046:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.038053:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521505.038063:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521505.038087:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521505.038109:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149760 00000100:00100000:0.0:1788521505.038117:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149760 00000100:00100000:0.0:1788521505.038154:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521505.038618:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+7:14413:x1875400368149760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521505.038627:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521505.038640:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6e800/0x53df1cebae01737f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017378 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.038655:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6e800/0x53df1cebae01737f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017378 expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.038664:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6e800/0x53df1cebae01737f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017378 expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.038670:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e800, rc 0) 00000100:00100000:0.0:1788521505.038698:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+8:14413:x1875400368149760:12345-0@lo:101:mount.lustre.0 Request processed in 528us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521505.038704:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521505.038736:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521505.038750:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521505.038760:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01737f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.038768:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01737f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521505.038840:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521505.038866:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521505.038982:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368149888 00000100:00100000:1.0:1788521505.038987:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368149888 00000100:00100000:1.0:1788521505.039021:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521505.039027:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+8:14413:x1875400368149888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521505.039549:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14413:x1875400368149888:12345-0@lo:501:mount.lustre.0 Request processed in 521us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.039557:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521505.039622:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521505.039642:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368149888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521505.039673:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521505.039707:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521505.039729:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.039799:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368150016 00000100:00100000:2.0:1788521505.039805:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368150016 00000100:00100000:2.0:1788521505.039840:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521505.039849:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14413:x1875400368150016:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521505.040516:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14413:x1875400368150016:12345-0@lo:503:mount.lustre.0 Request processed in 665us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.040524:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521505.040597:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521505.041325:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14449:1875400368150144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521505.041370:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521505.041439:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.041477:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368150144 00000100:00100000:1.0:1788521505.041483:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368150144 00000100:00100000:1.0:1788521505.041565:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521505.041574:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14449:x1875400368150144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521505.041867:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14449:x1875400368150144:12345-0@lo:502:llog_process_th.0 Request processed in 294us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.041876:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521505.041953:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14449:1875400368150144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788521505.041976:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521505.041987:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521505.041990:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788521505.041996:0:14449:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788521505.041999:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521505.042024:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c0941334d40) 00000020:00000080:0.0:1788521505.042041:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788521505.042046:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788521505.042115:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788521505.042134:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae01738d 00000020:00000080:0.0:1788521505.042347:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788521505.042352:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788521505.042355:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521505.042357:0:14449:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788521505.042360:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788521505.042363:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788521505.042365:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788521505.042368:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788521505.042376:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c09413319c0) 00000020:00000080:0.0:1788521505.042391:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788521505.042395:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788521505.042397:0:14449:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788521505.042399:0:14449:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788521505.042404:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788521505.042447:0:14449:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c09434dd000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788521505.042460:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c0a489a3380) 00000020:00000080:0.0:1788521505.042467:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788521505.042501:0:14449:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788521505.042505:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0173a2 00000020:00000080:0.0:1788521505.042590:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788521505.042596:0:14449:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788521505.042600:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x53df1cebae0173a9 00080000:01000000:0.0:1788521505.042605:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788521505.042608:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0173b0 00010000:00010000:2.0:1788521505.123625:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788521505.125723:0:14449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788521505.126622:0:14449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788521505.127734:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c0a456519c0) 00000020:00000080:2.0:1788521505.127756:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788521505.129396:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788521505.129414:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0173be 00000020:00000080:3.0:1788521505.134511:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788521505.143820:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x53df1cebae0173c5 00000020:00000080:3.0:1788521505.144385:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788521505.144396:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.144402:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.144404:0:14449:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788521505.144407:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521505.144413:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.144415:0:14449:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788521505.144420:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788521505.144453:0:14449:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788521505.144466:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.144470:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.144471:0:14449:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788521505.144474:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788521505.144476:0:14449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788521505.144477:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521505.144479:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521505.144480:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788521505.144483:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.144484:0:14449:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788521505.144487:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521505.144490:0:14449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788521505.144500:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.144501:0:14449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788521505.144506:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521505.144511:0:14449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:3.0:1788521505.144536:0:14449:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788521505.144539:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521505.144553:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0a7b9f0000) 00000020:00000080:3.0:1788521505.144566:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788521505.144572:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521505.144620:0:14449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788521505.144625:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788521505.144629:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0173d3 00010000:00080000:3.0:1788521505.144664:0:14449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a47c27000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1788521505.145333:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788521505.145673:0:14449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788521505.145717:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788521505.149689:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521505.149762:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788521505.150367:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788521505.154446:0:14453:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788521505.154454:0:14453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788521505.155605:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788521505.155619:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788521505.155651:0:14449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788521505.155670:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0173da 00000100:00080000:3.0:1788521505.155682:0:14449:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521505.155688:0:14449:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c0a47c27000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1788521505.155725:0:14449:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a6ddcb480 x1875400368150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521505.155817:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368150272:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788521505.155871:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400368150272 offset 0 length 520: 4 00000100:00080000:3.0:1788521505.156373:0:14449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788521505.156515:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.156520:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.156530:0:14449:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788521505.156535:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788521505.156537:0:14449:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788521505.156539:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521505.156540:0:14449:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521505.156542:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788521505.156544:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.156546:0:14449:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788521505.156549:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521505.156553:0:14449:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788521505.156556:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.156558:0:14449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788521505.156561:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788521505.156565:0:14449:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:3.0:1788521505.156585:0:14449:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788521505.156588:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521505.156601:0:14449:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c0a7b9f19c0) 00000020:00000080:3.0:1788521505.156616:0:14449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788521505.156621:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788521505.156681:0:14449:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788521505.156687:0:14449:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788521505.156692:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x53df1cebae0173e8 00010000:00080000:3.0:1788521505.156722:0:14449:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a60446800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1788521505.157024:0:14449:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788521505.157354:0:14449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788521505.157377:0:14449:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788521505.157853:0:14449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521505.157916:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788521505.157985:0:14449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788521505.159085:0:14455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788521505.159091:0:14455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788521505.160460:0:14449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788521505.160472:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788521505.160502:0:14449:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788521505.160520:0:14449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0173ef 00000100:00080000:3.0:1788521505.160535:0:14449:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788521505.160541:0:14449:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0a60446800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1788521505.160572:0:14449:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a6ddc8380 x1875400368150400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788521505.160586:0:14449:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788521505.160645:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.160649:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.160651:0:14449:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788521505.160654:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521505.160658:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.160659:0:14449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521505.160662:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521505.160664:0:14449:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788521505.160666:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.160669:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.160670:0:14449:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788521505.160673:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521505.160676:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.160677:0:14449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788521505.160680:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788521505.160708:0:14449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14449:1875400368150528:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521505.160968:0:14449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521505.161000:0:14449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.161134:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368150528 00000100:00100000:2.0:1788521505.161141:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368150528 00000100:00100000:2.0:1788521505.161189:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788521505.161198:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14449:x1875400368150528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521505.161603:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14449:x1875400368150528:12345-0@lo:502:llog_process_th.0 Request processed in 404us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.161612:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521505.161742:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368150400:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788521505.161791:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400368150400 offset 0 length 520: 4 00000100:00100000:0.0:1788521505.162318:0:14449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14449:1875400368150528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788521505.162416:0:14449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521505.162424:0:14449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521505.162426:0:14449:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521505.162432:0:14449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788521505.162589:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788521505.162607:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788521505.162653:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01737f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.162665:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f600/0x53df1cebae017378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01737f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521505.162673:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c09434dd000 from 1 10000000:01000000:0.0:1788521505.162677:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788521505.162706:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.162714:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.162736:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521505.162753:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521505.163470:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.163539:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.163583:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368150656 00000100:00100000:1.0:1788521505.163589:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368150656 00000100:00100000:1.0:1788521505.163664:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521505.163674:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+9:14413:x1875400368150656:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521505.163687:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521505.163703:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0173f6 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.163725:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.163734:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.163741:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a200, rc 0) 00000100:00100000:1.0:1788521505.163925:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+10:14413:x1875400368150656:12345-0@lo:101:mount.lustre.0 Request processed in 251us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.163931:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521505.164361:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521505.164376:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.164385:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521505.165292:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150784:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788521505.165345:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521505.165422:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.165477:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368150784 00000100:00100000:1.0:1788521505.165484:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368150784 00000100:00100000:1.0:1788521505.165523:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521505.165530:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+10:14413:x1875400368150784:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788521505.165546:0:14426:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788521505.165551:0:14426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788521505.165698:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+10:14413:x1875400368150784:12345-0@lo:256:mount.lustre.0 Request processed in 167us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.165706:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521505.165803:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150784:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788521505.166572:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788521505.166591:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.166603:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521505.166613:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c09434dd000 from 1 10000000:01000000:0.0:1788521505.166616:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521505.166647:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.166655:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521505.166665:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521505.166681:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521505.166720:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521505.166750:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a60b17f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.167074:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368150912 00000100:00100000:1.0:1788521505.167080:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368150912 00000100:00100000:1.0:1788521505.167129:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521505.167138:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+10:14413:x1875400368150912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521505.167148:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521505.167170:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017404 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.167191:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017404 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.167200:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017404 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521505.167209:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b400, rc 0) 00000100:00100000:1.0:1788521505.167406:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368150912:12345-0@lo:101:mount.lustre.0 Request processed in 268us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.167426:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521505.167497:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368150912:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521505.167511:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521505.167520:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521505.167574:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521505.167599:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521505.167626:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.167728:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151040 00000100:00100000:1.0:1788521505.167732:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151040 00000100:00100000:1.0:1788521505.167751:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788521505.167757:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368151040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521505.168447:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368151040:12345-0@lo:501:mount.lustre.0 Request processed in 688us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.168456:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521505.169029:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521505.169075:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521505.169293:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521505.169350:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.169406:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151168 00000100:00100000:1.0:1788521505.169411:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151168 00000100:00100000:1.0:1788521505.169474:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788521505.169482:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368151168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521505.169641:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368151168:12345-0@lo:503:mount.lustre.0 Request processed in 159us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.169648:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788521505.169714:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521505.170137:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14457:1875400368151296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521505.170182:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521505.170472:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521505.170541:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151296 00000100:00100000:0.0:1788521505.170553:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151296 00000100:00100000:0.0:1788521505.170578:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788521505.170584:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14457:x1875400368151296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788521505.170805:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14457:x1875400368151296:12345-0@lo:502:llog_process_th.0 Request processed in 219us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521505.170812:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788521505.170902:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14457:1875400368151296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521505.170925:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521505.170938:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.170941:0:14457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788521505.170947:0:14457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c09434dd000 00000020:00000080:3.0:1788521505.170950:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521505.170957:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.170960:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.170961:0:14457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788521505.170964:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521505.170966:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.170968:0:14457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788521505.170971:0:14457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c09434dd000 00000020:00000080:3.0:1788521505.170973:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521505.171034:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.171037:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.171039:0:14457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788521505.171041:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521505.171044:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.171045:0:14457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521505.171048:0:14457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c09434dd000 00000020:00000080:3.0:1788521505.171050:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788521505.171085:0:14457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14457:1875400368151424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788521505.171130:0:14457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521505.171151:0:14457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a50dc43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521505.173388:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151424 00000100:00100000:1.0:1788521505.173401:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151424 00000100:00100000:1.0:1788521505.173449:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521505.173457:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14457:x1875400368151424:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788521505.173676:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14457:x1875400368151424:12345-0@lo:502:llog_process_th.0 Request processed in 219us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521505.173684:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521505.173817:0:14457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14457:1875400368151424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788521505.173847:0:14457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521505.173853:0:14457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521505.173856:0:14457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788521505.173860:0:14457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788521505.175419:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788521505.175446:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521505.175474:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.175487:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521505.175534:0:14413:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521505.175537:0:14413:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c09434dd000 10000000:01000000:2.0:1788521505.175540:0:14413:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c09434dd000 10000000:01000000:2.0:1788521505.175543:0:14413:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521505.175548:0:14413:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c09434dd000 from 1 10000000:01000000:2.0:1788521505.175551:0:14413:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521505.175584:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.175599:0:14413:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.175610:0:14413:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521505.175632:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521505.175686:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.175719:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a507de3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.175738:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151552 00000100:00100000:2.0:1788521505.175743:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151552 00000100:00100000:2.0:1788521505.175804:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521505.175812:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368151552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521505.175824:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521505.175838:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae017419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017412 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.175858:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae017419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017412 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.175869:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a1c00/0x53df1cebae017419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017412 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.175878:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1c00, rc 0) 00000100:00100000:2.0:1788521505.177369:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14413:x1875400368151552:12345-0@lo:101:mount.lustre.0 Request processed in 1551us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.177379:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788521505.177472:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521505.177494:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017419 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.177507:0:14413:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017419 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521505.177575:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521505.177609:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.177636:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.177652:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151680 00000100:00100000:2.0:1788521505.177657:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151680 00000100:00100000:2.0:1788521505.177688:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521505.177696:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14413:x1875400368151680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521505.180082:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14413:x1875400368151680:12345-0@lo:501:mount.lustre.0 Request processed in 2380us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.180095:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788521505.180176:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521505.182298:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521505.182366:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.182415:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.182441:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151808 00000100:00100000:2.0:1788521505.182447:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151808 00000100:00100000:2.0:1788521505.182484:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521505.182491:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14413:x1875400368151808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521505.182659:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14413:x1875400368151808:12345-0@lo:503:mount.lustre.0 Request processed in 167us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.182671:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788521505.182718:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368151808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521505.182905:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14461:1875400368151936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521505.182934:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.182949:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368151936 00000100:00100000:2.0:1788521505.182951:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368151936 00000100:00100000:2.0:1788521505.182967:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521505.182971:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14461:x1875400368151936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521505.183116:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14461:x1875400368151936:12345-0@lo:502:llog_process_th.0 Request processed in 144us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.183123:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788521505.183146:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.183156:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14461:1875400368151936:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788521505.183198:0:14461:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788521505.185971:0:14461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c0a45653380) 00000020:00000080:2.0:1788521505.186001:0:14461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788521505.186098:0:14461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c09434dd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788521505.186102:0:14461:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c09434dd000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788521505.186105:0:14461:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c09434dd000 4 00010000:00080000:2.0:1788521505.186310:0:14461:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0941157000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:2.0:1788521505.193813:0:14461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788521505.196134:0:14461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788521505.196182:0:14461:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788521505.196194:0:14461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x53df1cebae017427 00000100:00080000:2.0:1788521505.196204:0:14461:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788521505.198114:0:14461:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0941157000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521505.198352:0:14461:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0941355c00 x1875400368152064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521505.198404:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368152064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788521505.198469:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788521505.198529:0:14461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788521505.198756:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152064 00000100:00100000:0.0:1788521505.198763:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152064 00000100:00100000:0.0:1788521505.198807:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521505.198815:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875400368152064:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788521505.198871:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1875400368152064:12345-0@lo:38:llog_process_th.0 Request processed in 56us (402us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788521505.198879:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521505.198927:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521505.198935:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0941157000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788521505.198939:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788521505.198943:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368152064:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788521505.200087:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14461:1875400368152192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521505.202037:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.202079:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152192 00000100:00100000:2.0:1788521505.202086:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152192 00000100:00100000:2.0:1788521505.202137:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521505.202146:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14461:x1875400368152192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788521505.202492:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14461:x1875400368152192:12345-0@lo:502:llog_process_th.0 Request processed in 347us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.202501:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788521505.202555:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.202576:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14461:1875400368152192:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788521505.202610:0:14461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788521505.202665:0:14413:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788521505.202685:0:14413:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788521505.202708:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017419 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.202720:0:14413:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1600/0x53df1cebae017412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017419 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788521505.202759:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788521505.202765:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521505.202766:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521505.202767:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521505.202768:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521505.202770:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521505.202787:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521505.202789:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788521505.202791:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521505.202792:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521505.202795:0:14413:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788521505.202798:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521505.202799:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521505.202801:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521505.202802:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521505.202803:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521505.202804:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521505.202805:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521505.202806:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788521505.202807:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521505.202808:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788521505.202823:0:14413:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788521505.202836:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368152320:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521505.202867:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.202880:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.205435:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152320 00000100:00100000:2.0:1788521505.205444:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152320 00000100:00100000:2.0:1788521505.205495:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521505.205504:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14413:x1875400368152320:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788521505.205547:0:14426:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788521505.205562:0:14426:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788521505.277740:0:14426:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521505.277759:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788521505.277856:0:14447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788521505.277861:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788521505.277885:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.277903:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.277925:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.277963:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.277977:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 12 pid: 14426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521505.277991:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1875400368152448:0@lo:104: 00000100:00100000:2.0:1788521505.278067:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.278117:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1788521505.278165:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152448 00000100:00100000:2.0:1788521505.278171:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152448 00000100:00100000:2.0:1788521505.278326:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521505.278338:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14447:x1875400368152448:12345-0@lo:104: 00010000:00010000:2.0:1788521505.278351:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278401:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521505.278408:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14447:x1875400368152448:12345-0@lo:104: Request processed in 73us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.278415:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788521505.278439:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521505.278444:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278450:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fe00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:2.0:1788521505.278460:0:14421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278468:0:14421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788521505.278474:0:14421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521505.278479:0:14421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788521505.278507:0:14421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278513:0:14421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788521505.278531:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278538:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fe00/0x53df1cebae0173f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0173fd expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278552:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521505.278554:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521505.278556:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521505.278582:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3301:1875400368152576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521505.278608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521505.278658:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152576 00000100:00100000:2.0:1788521505.278662:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152576 00010000:00010000:2.0:1788521505.278678:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 13 pid: 14426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521505.278698:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521505.278712:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+13:3301:x1875400368152576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521505.278723:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521505.278728:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 13 pid: 14426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278739:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 13 pid: 14426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278753:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278761:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788521505.278800:0:14417:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000939720s 00010000:00010000:2.0:1788521505.278805:0:14417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278811:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278819:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278825:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278830:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521505.278834:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278852:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278861:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.278871:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521505.278901:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941356d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+13:3301:x1875400368152576:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521505.278908:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521505.278944:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3301:1875400368152576:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521505.278972:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a7575a200/0x53df1cebae0173fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0173f6 expref: 12 pid: 14426 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521505.278981:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1875400368152448:0@lo:104: 00010000:00010000:2.0:1788521505.278992:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.279000:0:14447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.279021:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521505.279028:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0600/0x53df1cebae01742e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521505.291170:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14413:x1875400368152320:12345-0@lo:253:mount.lustre.0 Request processed in 85649us (88284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521505.291202:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788521505.291455:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14413:1875400368152320:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521505.291476:0:14413:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788521505.291479:0:14413:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521505.291481:0:14413:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788521505.291482:0:14413:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521505.291484:0:14413:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521505.291485:0:14413:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521505.291486:0:14413:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521505.291487:0:14413:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788521505.291489:0:14413:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788521505.291491:0:14413:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521505.291492:0:14413:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521505.291507:0:14413:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788521505.302529:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521505.302694:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521505.303059:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521505.303374:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521505.303642:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521505.303914:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521505.304977:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521505.305331:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521505.305592:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521505.306037:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788521505.306477:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788521505.306637:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788521505.328670:0:14413:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788521505.329074:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788521505.329507:0:14471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788521505.329571:0:14471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788521505.333332:0:14470:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788521505.333338:0:14470:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1788521505.333804:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788521505.333942:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788521505.334366:0:14413:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788521505.334374:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788521505.334508:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521505.335430:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788521505.336214:0:14471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788521505.336283:0:14471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788521505.336288:0:14471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1788521505.337465:0:14413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788521505.337521:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788521505.339482:0:14413:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1788521505.346265:0:14413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788521505.376768:0:14413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788521505.376843:0:14413:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb00781c6f988 00100000:10000000:2.0:1788521505.376851:0:14413:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788521505.377755:0:14413:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788521505.377802:0:14413:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788521505.377817:0:14413:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788521505.377832:0:14413:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788521505.897279:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788521506.024890:0:14429:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788521506.024898:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c09434dd000 from 6 10000000:01000000:2.0:1788521506.024903:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788521506.024953:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521506.024964:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521506.024975:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521506.025010:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368152704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521506.025081:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521506.025199:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521506.026276:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152704 00000100:00100000:0.0:1788521506.026286:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152704 00000100:00100000:0.0:1788521506.026343:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788521506.026353:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14429:x1875400368152704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521506.026367:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521506.026383:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017435 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521506.026408:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017435 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521506.026419:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017435 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521506.026427:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6ee00, rc 0) 00000100:00100000:0.0:1788521506.026479:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368152704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521506.026486:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788521506.026591:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368152704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521506.026606:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.026616:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521506.026683:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368152832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788521506.026717:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521506.026750:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4f937540 going to sleep for 11 seconds 00000100:00100000:2.0:1788521506.026813:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152832 00000100:00100000:2.0:1788521506.026817:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152832 00000100:00100000:2.0:1788521506.026852:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788521506.026859:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368152832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788521506.026872:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788521506.026886:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788521506.026889:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788521506.026971:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368152832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521506.026978:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788521506.027060:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368152832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788521506.027101:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521506.027109:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521506.027117:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521506.295424:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521506.926390:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521507.305429:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788521507.946258:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521508.968969:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521509.992912:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788521510.470021:0:14713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788521510.506307:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521510.506314:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521510.506316:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521510.506319:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521510.506322:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788521510.506325:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788521510.506328:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c0941157000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521510.506339:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0941157000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1788521510.506359:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a6ddc9f80 x1875400368153088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788521510.506407:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368152960:0@lo:400:kworker.0 00000100:00100000:3.0:1788521510.506466:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521510.506523:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368153088:0@lo:38:kworker.0 00000100:00100000:3.0:1788521510.506553:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521510.506594:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368152960 00000100:00100000:3.0:1788521510.506601:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368152960 00000100:00100000:3.0:1788521510.506651:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521510.506659:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:3302:x1875400368152960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521510.506705:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:3302:x1875400368152960:12345-0@lo:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521510.506711:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788521510.506747:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153088 00000100:00100000:3.0:1788521510.506751:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153088 00000100:00100000:3.0:1788521510.506795:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521510.506800:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875400368153088:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788521510.506819:0:14433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 431 last 0 00000020:00000080:3.0:1788521510.506853:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x53df1cebae017443 00000004:00100000:3.0:1788521510.506866:0:14433:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788521510.507076:0:14433:0:(import.c:65:import_set_state_nolock()) ffff8c0a79c11000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521510.507127:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1875400368153088:12345-0@lo:38:kworker.0 Request processed in 325us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521510.507134:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521510.507169:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368152960:0@lo:400:kworker.0 00010000:00080000:2.0:1788521510.507179:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0a6ddc9f80 x1875400368153088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788521510.507192:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788521510.507198:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788521510.507203:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788521510.507205:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0941157000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788521510.507210:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1875400368153088:0@lo:38:kworker.0 00010000:00010000:2.0:1788521511.016989:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521512.042701:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521513.065821:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788521513.870514:0:14864:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd2fb99800 20000000:00000080:0.0:1788521513.870530:0:14864:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c0a6f32ac00 uarg=0000000000000000 20000000:01000000:0.0:1788521513.870563:0:14864:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788521513.870570:0:14864:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788521513.870575:0:14864:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788521513.876652:0:14865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788521513.876910:0:14864:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788521513.886633:0:14864:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788521513.889232:0:14864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521513.889259:0:14864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017404 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521513.889268:0:14864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521513.889318:0:14864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae017404 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521513.889335:0:14864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae017404 expref: 11 pid: 14427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521513.889350:0:14864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14864:1875400368153216:0@lo:104: 00000100:00100000:1.0:1788521513.889413:0:14864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521513.889503:0:14864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4f9373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521513.889559:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153216 00000100:00100000:2.0:1788521513.889566:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153216 00000100:00100000:2.0:1788521513.889687:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788521513.889697:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14864:x1875400368153216:12345-0@lo:104: 00010000:00010000:2.0:1788521513.889711:0:14416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521513.889874:0:14416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521513.889882:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14864:x1875400368153216:12345-0@lo:104: Request processed in 187us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521513.889890:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521513.889981:0:14864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14864:1875400368153216:0@lo:104: 00010000:00010000:3.0:1788521513.890004:0:14864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890179:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521513.890187:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890195:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521513.890199:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890208:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521513.890215:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521513.890221:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788521513.890259:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890265:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521513.890286:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890293:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6fa00/0x53df1cebae017404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01740b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890310:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521513.890312:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521513.890313:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521513.890325:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368153344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521513.890359:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521513.890414:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153344 00000100:00100000:0.0:1788521513.890419:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153344 00010000:00010000:0.0:1788521513.890439:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae017404 expref: 12 pid: 14427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521513.890460:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521513.890466:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:3303:x1875400368153344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521513.890477:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521513.890482:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae017404 expref: 12 pid: 14427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890492:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae017404 expref: 12 pid: 14427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890505:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a7575b400/0x53df1cebae01740b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae017404 expref: 12 pid: 14427 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890518:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890527:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890540:0:14417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890548:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890555:0:14417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890571:0:14417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890576:0:14417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521513.890581:0:14417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890588:0:14417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890599:0:14417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521513.890608:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521513.890646:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:3303:x1875400368153344:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521513.890653:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521513.890680:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368153344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521513.891166:0:14864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521513.891175:0:14864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521513.891188:0:14864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a7575b000/0x53df1cebae01744a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521514.089396:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521515.114252:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788521515.241309:0:14429:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788521515.241318:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c09434dd000 from 10 10000000:01000000:3.0:1788521515.241323:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788521515.241378:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521515.241390:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521515.241402:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521515.241427:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368153472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788521515.241491:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521515.241573:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153472 00000100:00100000:3.0:1788521515.241574:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a75d0c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521515.241583:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153472 00000100:00100000:0.0:1788521515.241650:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788521515.241661:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+11:14429:x1875400368153472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521515.241674:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521515.241689:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017451 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.241727:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017451 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.241753:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017451 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521515.241793:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e000, rc 0) 00000100:00100000:0.0:1788521515.242868:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368153472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1205us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521515.242876:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788521515.244218:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368153472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521515.244246:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521515.244258:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521515.244338:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368153600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521515.244388:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521515.244506:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4f937900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521515.249491:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153600 00000100:00100000:3.0:1788521515.249507:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153600 00000100:00100000:3.0:1788521515.249582:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788521515.249592:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368153600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521515.250402:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368153600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 810us (6011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521515.250412:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788521515.250931:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368153600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521515.251199:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368153728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521515.251256:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521515.251298:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4f937900 going to sleep for 11 seconds 00000100:00100000:0.0:1788521515.253929:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153728 00000100:00100000:0.0:1788521515.253956:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153728 00000100:00100000:0.0:1788521515.254044:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788521515.254055:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368153728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521515.254301:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:14429:x1875400368153728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 248us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521515.254309:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788521515.254361:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368153728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521515.256329:0:14925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788521515.256659:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788521515.256678:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521515.256691:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521515.256959:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521515.625391:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521505/real 1788521505] req@ffff8c0a6ddc8380 x1875400368150400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521515.625439:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c0a6ddc8380 x1875400368150400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521515.625450:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521505/real 1788521505] req@ffff8c0a6ddcb480 x1875400368150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521515 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521515.625464:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c0a6ddcb480 x1875400368150272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521515 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788521515.625486:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521515.640630:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521515.640641:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788521515.640645:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521515.640649:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788521515.640653:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521515.640664:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:2.0:1788521515.640671:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788521515.640680:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0a60446800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521515.640730:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0941357800 x1875400368153856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521515.640826:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368153984:0@lo:400:kworker.0 00000100:00100000:2.0:1788521515.640913:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521515.641044:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368153984 00000100:00100000:2.0:1788521515.641258:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368153984 00000100:00100000:2.0:1788521515.641326:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521515.641338:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521515.641401:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368153984:12345-0@lo:400:kworker.0 Request processed in 66us (489us total) trans 0 rc 0/0 00010000:00080000:3.0:1788521515.641900:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0941355880 x1875400368153984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521515.641919:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368153984:0@lo:400:kworker.0 00000100:00100000:2.0:1788521515.642646:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788521515.643581:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788521515.643592:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368150400:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788521515.644683:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521515.644692:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788521515.644713:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a47c27000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521515.644737:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788521515.644743:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368150272:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788521515.645045:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368153856:0@lo:8:kworker.0 00000400:00000100:2.0:1788521515.645203:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400368153856 offset 0 length 520: 4 00000100:00080000:3.0:1788521515.646173:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521515.646182:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788521515.646186:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c0a47c27000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788521515.646195:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 426 00000100:00080000:3.0:1788521515.646202:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788521515.646210:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c0a47c27000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1788521515.646261:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a6ddcb800 x1875400368154112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521515.646345:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368154112:0@lo:8:kworker.0 00000400:00000100:1.0:1788521515.646396:0:3299:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875400368154112 offset 0 length 520: 4 00010000:00010000:2.0:1788521516.149041:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521517.161177:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521517.550519:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521518.187297:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521519.209111:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521519.260420:0:15113:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788521519.260424:0:15113:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788521519.260534:0:15113:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c0a79c76000 00000020:01000004:2.0:1788521519.260549:0:15113:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788521519.260561:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788521519.260588:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c0a76e63380) 00000020:00000080:2.0:1788521519.260605:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788521519.278763:0:15113:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788521519.279150:0:15113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788521519.279708:0:15113:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788521519.279972:0:15113:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788521519.280180:0:15113:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788521519.281433:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 563: rc = 0 00100000:10000000:3.0:1788521519.281526:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 563: rc = 0 00100000:10000000:3.0:1788521519.281693:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 563: rc = 0 00100000:10000000:3.0:1788521519.282217:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 685: rc = 0 00100000:10000000:3.0:1788521519.282546:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 685: rc = 0 00100000:10000000:3.0:1788521519.282839:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 685: rc = 0 00100000:10000000:3.0:1788521519.283110:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 685: rc = 0 00100000:10000000:3.0:1788521519.283357:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 685: rc = 0 00100000:10000000:3.0:1788521519.284377:0:15113:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 685: rc = 0 00000020:00000080:3.0:1788521519.285039:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788521519.285050:0:15113:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788521519.285061:0:15113:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x53df1cebae017466 00000020:01000004:3.0:1788521519.285075:0:15113:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788521519.285097:0:15113:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788521519.285101:0:15113:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788521519.285107:0:15113:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788521519.285112:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788521519.285124:0:15113:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c0a7b9f3380) 00000020:00000080:3.0:1788521519.285134:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788521519.286288:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788521519.286457:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788521519.286463:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788521519.289020:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788521519.289032:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788521519.293744:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521519.293756:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788521519.296519:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521519.296712:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788521519.296720:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788521519.297543:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788521519.297552:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788521519.316496:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521519.316733:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788521519.316740:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788521519.318460:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788521519.318471:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788521519.319335:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788521519.319344:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788521519.324063:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788521519.324257:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788521519.324263:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788521519.328600:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788521519.328613:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788521519.376536:0:15113:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788521519.376732:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788521519.376739:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788521519.377933:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788521519.377943:0:15113:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788521519.378680:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788521519.378705:0:15113:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788521519.378711:0:15113:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788521519.388766:0:15113:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788521519.388833:0:15113:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788521519.388837:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788521519.388839:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521519.400280:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521519.400282:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521519.400283:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521519.400286:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521519.400288:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521519.400289:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521519.400290:0:15113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521519.400296:0:15113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788521519.400299:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788521519.400300:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521519.400301:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521519.400302:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521519.400303:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521519.400304:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521519.400305:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521519.400306:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521519.400308:0:15113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788521519.400361:0:15113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788521519.400382:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154240:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788521519.400476:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521519.400534:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a489fe900 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.400637:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368154240 00000100:00100000:3.0:1788521519.400645:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368154240 00000100:00100000:3.0:1788521519.400703:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788521519.400712:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:15113:x1875400368154240:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788521519.400747:0:14426:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788521519.400750:0:14426:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788521519.400753:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788521519.423266:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:15113:x1875400368154240:12345-0@lo:253:mount.lustre.0 Request processed in 22547us (22781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521519.423280:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788521519.423407:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154240:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521519.423423:0:15113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788521519.423426:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521519.423428:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788521519.423429:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521519.423430:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521519.423431:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521519.423433:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521519.423434:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521519.423436:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521519.423437:0:15113:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788521519.423457:0:15113:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0a79c76000 from lustre-OST0000 10000000:01000000:2.0:1788521519.423482:0:15113:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788521519.423485:0:15113:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788521519.423491:0:15113:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c0941330000 local copy 00010000:00010000:2.0:1788521519.423500:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521519.423757:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521519.423838:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521519.423866:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a489fe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521519.423997:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368154368 00000100:00100000:0.0:1788521519.424004:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368154368 00000100:00100000:0.0:1788521519.424057:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788521519.424066:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:15113:x1875400368154368:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521519.424229:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:15113:x1875400368154368:12345-0@lo:501:mount.lustre.0 Request processed in 165us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521519.424237:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788521519.424379:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788521519.424397:0:15113:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788521519.424554:0:15113:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788521519.424561:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.424571:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521519.424604:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0a79c76000 10000000:01000000:1.0:1788521519.424608:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788521519.424613:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8c0941330000 10000000:01000000:1.0:1788521519.424615:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788521519.424619:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8c0941330000 from 1 10000000:01000000:1.0:1788521519.424622:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788521519.424645:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.424654:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.424664:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521519.424686:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521519.424727:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.424765:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51300 going to sleep for 11 seconds 00000100:00100000:0.0:1788521519.424900:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368154496 00000100:00100000:0.0:1788521519.424915:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368154496 00000100:00100000:0.0:1788521519.424952:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788521519.424960:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+12:15113:x1875400368154496:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521519.424970:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521519.424985:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6f800/0x53df1cebae01747b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017474 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.425007:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6f800/0x53df1cebae01747b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017474 expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.425017:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6f800/0x53df1cebae01747b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017474 expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.425137:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f800, rc 0) 00000100:00100000:0.0:1788521519.425181:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+13:15113:x1875400368154496:12345-0@lo:101:mount.lustre.0 Request processed in 222us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521519.425188:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788521519.425408:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521519.425422:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01747b expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.425431:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01747b expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521519.425449:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788521519.425467:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01747b expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.425475:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575b600/0x53df1cebae017474 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01747b expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521519.425481:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788521519.425485:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521519.425489:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788521519.425491:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788521519.425507:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.425514:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.425521:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521519.425541:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521519.425567:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.425597:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51300 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.425691:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368154624 00000100:00100000:2.0:1788521519.425696:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368154624 00000100:00100000:2.0:1788521519.425728:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788521519.425736:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+13:15113:x1875400368154624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521519.425744:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521519.425754:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0a00/0x53df1cebae017489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017482 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521519.425769:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0a00/0x53df1cebae017489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017482 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521519.425807:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a0a00/0x53df1cebae017489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017482 expref: 14 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521519.425813:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0a00, rc 0) 00000100:00100000:2.0:1788521519.425851:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368154624:12345-0@lo:101:mount.lustre.0 Request processed in 116us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521519.425857:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788521519.425994:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521519.426005:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017489 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.426014:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017489 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521519.427409:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788521519.428595:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521519.428911:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788521519.428956:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788521519.428986:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788521519.429037:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788521519.429069:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788521519.429100:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788521519.429162:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788521519.429169:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788521519.429261:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521519.429322:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521519.429386:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368154752 00000100:00100000:3.0:1788521519.429393:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368154752 00000100:00100000:3.0:1788521519.429444:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788521519.429453:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368154752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521519.429491:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a465db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.429806:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368154752:12345-0@lo:501:mount.lustre.0 Request processed in 353us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.429815:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788521519.430580:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521519.430634:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521519.430682:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.430716:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a465db180 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.431113:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368154880 00000100:00100000:2.0:1788521519.431120:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368154880 00000100:00100000:2.0:1788521519.431215:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788521519.431225:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368154880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521519.431587:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368154880:12345-0@lo:503:mount.lustre.0 Request processed in 363us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521519.431600:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788521519.431686:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368154880:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521519.432428:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521519.432489:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155008:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521519.432533:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.438097:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.440472:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155008 00000100:00100000:3.0:1788521519.440485:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155008 00000100:00100000:3.0:1788521519.440546:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788521519.440556:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368155008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521519.443005:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368155008:12345-0@lo:502:mount.lustre.0 Request processed in 2443us (10463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.443031:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788521519.444966:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155008:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521519.445324:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788521519.445387:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788521519.445422:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788521519.445484:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788521519.445524:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788521519.445556:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788521519.445602:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788521519.445637:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788521519.445668:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788521519.445713:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788521519.445747:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788521519.448549:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788521519.448615:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521519.448696:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.448751:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.448956:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155136 00000100:00100000:2.0:1788521519.448967:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155136 00000100:00100000:2.0:1788521519.449187:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788521519.449198:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368155136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521519.449898:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368155136:12345-0@lo:502:mount.lustre.0 Request processed in 700us (1199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.449916:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788521519.450086:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521519.450194:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788521519.450206:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788521519.455300:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788521519.455314:0:15127:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788521519.455321:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.455323:0:15127:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788521519.455332:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788521519.455348:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c0a7b9f4d40) 00000020:00000080:3.0:1788521519.455371:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788521519.455378:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788521519.455445:0:15127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a79c76000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788521519.455453:0:15127:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788521519.455465:0:15127:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x53df1cebae017497 00010000:00010000:3.0:1788521519.464189:0:15127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788521519.465263:0:15127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788521519.475625:0:15127:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788521519.478974:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788521519.478987:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521519.478994:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.478996:0:15127:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788521519.478999:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788521519.479002:0:15127:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788521519.479004:0:15127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521519.479005:0:15127:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788521519.479007:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788521519.479009:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.479011:0:15127:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788521519.479013:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521519.479016:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.479029:0:15127:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788521519.479034:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788521519.479035:0:15127:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788521519.479038:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521519.479040:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.479042:0:15127:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788521519.479044:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521519.479047:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.479049:0:15127:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788521519.479052:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788521519.479114:0:15127:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521519.479118:0:15127:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.479120:0:15127:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788521519.479123:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788521519.480975:0:15113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788521519.481019:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788521519.481043:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017489 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.481057:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a800/0x53df1cebae017482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017489 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521519.481065:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a79c76000 from 1 10000000:01000000:0.0:1788521519.481068:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521519.481109:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.481118:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.481128:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521519.481150:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155264:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788521519.481222:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.481262:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.481326:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155264 00000100:00100000:3.0:1788521519.481333:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155264 00000100:00100000:3.0:1788521519.481376:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788521519.481386:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+14:15113:x1875400368155264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521519.481398:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521519.481411:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae01749e expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521519.481434:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae01749e expref: 15 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521519.481444:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01749e expref: 15 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521519.481452:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030600, rc 0) 00000100:00100000:3.0:1788521519.481489:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155264:12345-0@lo:101:mount.lustre.0 Request processed in 105us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.481497:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788521519.483820:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155264:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521519.483844:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.483856:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521519.484356:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788521519.484673:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521519.484927:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788521519.484970:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788521519.485034:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788521519.485042:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788521519.485111:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521519.485169:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.485209:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521519.485293:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155392 00000100:00100000:1.0:1788521519.485299:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155392 00000100:00100000:1.0:1788521519.485345:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788521519.485354:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521519.485539:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155392:12345-0@lo:501:mount.lustre.0 Request processed in 186us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521519.485548:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788521519.485831:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521519.485896:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521519.485943:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.485962:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.486011:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155520 00000100:00100000:2.0:1788521519.486016:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155520 00000100:00100000:2.0:1788521519.486042:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788521519.486050:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155520:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521519.486198:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155520:12345-0@lo:503:mount.lustre.0 Request processed in 149us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521519.486205:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788521519.486278:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788521519.486668:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788521519.486721:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521519.486760:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.486859:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.491129:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155648 00000100:00100000:2.0:1788521519.491143:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155648 00000100:00100000:2.0:1788521519.491209:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788521519.491219:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521519.491639:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155648:12345-0@lo:502:mount.lustre.0 Request processed in 421us (4878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521519.491649:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788521519.491995:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521519.492304:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788521519.492356:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788521519.492407:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788521519.492444:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788521519.492474:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788521519.492517:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788521519.492551:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788521519.492603:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788521519.492640:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521519.492692:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.492737:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.494395:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155776 00000100:00100000:2.0:1788521519.494406:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155776 00000100:00100000:2.0:1788521519.494456:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788521519.494465:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521519.494710:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155776:12345-0@lo:502:mount.lustre.0 Request processed in 245us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521519.494728:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788521519.495105:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521519.495253:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788521519.495271:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788521519.503196:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521519.503213:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.503215:0:15131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788521519.503225:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a79c76000 00000020:00000080:3.0:1788521519.503227:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521519.503234:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521519.503236:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.503237:0:15131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788521519.503240:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521519.503243:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.503244:0:15131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788521519.503248:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a79c76000 00000020:00000080:3.0:1788521519.503250:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521519.503307:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521519.503310:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.503312:0:15131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788521519.503314:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788521519.503316:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.503318:0:15131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788521519.503321:0:15131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c0a79c76000 00000020:00000080:3.0:1788521519.503323:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521519.503356:0:15131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521519.503360:0:15131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521519.503361:0:15131:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788521519.503364:0:15131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788521519.508511:0:15113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788521519.508555:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788521519.508573:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.508586:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521519.508648:0:15113:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788521519.508651:0:15113:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0a79c76000 10000000:01000000:1.0:1788521519.508653:0:15113:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0a79c76000 10000000:01000000:1.0:1788521519.508657:0:15113:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788521519.508662:0:15113:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a79c76000 from 1 10000000:01000000:1.0:1788521519.508665:0:15113:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788521519.508700:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.508709:0:15113:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.508720:0:15113:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521519.508746:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155904:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788521519.508838:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.508878:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368155904 00000100:00100000:1.0:1788521519.508885:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368155904 00000100:00100000:1.0:1788521519.508932:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521519.508941:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368155904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521519.508953:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521519.508964:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a7575a600/0x53df1cebae0174b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0174ac expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.508987:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575a600/0x53df1cebae0174b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0174ac expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.509008:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a7575a600/0x53df1cebae0174b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0174ac expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.509016:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a600, rc 0) 00000100:00100000:1.0:1788521519.509049:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368155904:12345-0@lo:101:mount.lustre.0 Request processed in 108us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521519.509056:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788521519.509095:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f7a39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521519.509116:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368155904:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521519.509129:0:15113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174b3 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.509137:0:15113:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0174b3 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788521519.509662:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788521519.510346:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788521519.510582:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788521519.510626:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788521519.510661:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788521519.510709:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788521519.510744:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788521519.510820:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788521519.510857:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788521519.510892:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788521519.525009:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788521519.525115:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788521519.525151:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788521519.525227:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788521519.525260:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788521519.525291:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788521519.525339:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788521519.525373:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788521519.525404:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788521519.525446:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788521519.525475:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788521519.525500:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788521519.525543:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788521519.525577:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788521519.525608:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788521519.525649:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788521519.525684:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788521519.525714:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788521519.525761:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788521519.525837:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788521519.525937:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788521519.525946:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788521519.526054:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521519.526124:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.526177:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f7a39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521519.531953:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156032 00000100:00100000:1.0:1788521519.531972:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156032 00000100:00100000:1.0:1788521519.532052:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521519.532063:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521519.532383:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156032:12345-0@lo:501:mount.lustre.0 Request processed in 321us (6258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521519.532391:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788521519.532469:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156032:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521519.532530:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156160:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521519.532576:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.537010:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f7a39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.543433:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156160 00000100:00100000:3.0:1788521519.543449:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156160 00000100:00100000:3.0:1788521519.543547:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521519.543558:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521519.543897:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156160:12345-0@lo:503:mount.lustre.0 Request processed in 340us (11320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.543919:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788521519.543982:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156160:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788521519.544681:0:15113:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521519.544759:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521519.544836:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521519.544876:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4f937f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.544898:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156288 00000100:00100000:3.0:1788521519.544918:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156288 00000100:00100000:3.0:1788521519.544946:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521519.544954:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521519.545168:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156288:12345-0@lo:502:mount.lustre.0 Request processed in 215us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.545175:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788521519.545244:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521519.545467:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788521519.545508:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788521519.545539:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788521519.545586:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788521519.545637:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788521519.545683:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788521519.545719:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788521519.545752:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788521519.545824:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788521519.545862:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788521519.545896:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788521519.545978:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788521519.546015:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788521519.546049:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788521519.546096:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788521519.546134:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788521519.546170:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788521519.546219:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788521519.546256:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788521519.546293:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788521519.546360:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788521519.546397:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788521519.546431:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788521519.551462:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788521519.551565:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788521519.551601:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788521519.551644:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788521519.551678:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788521519.551713:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788521519.551764:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788521519.551817:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788521519.551846:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788521519.551873:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788521519.551924:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788521519.551956:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788521519.552029:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788521519.552083:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788521519.552121:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788521519.552175:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788521519.552209:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788521519.552261:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521519.552333:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521519.552373:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4f937f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.552416:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156416 00000100:00100000:3.0:1788521519.552422:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156416 00000100:00100000:3.0:1788521519.552468:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521519.552476:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521519.552675:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156416:12345-0@lo:502:mount.lustre.0 Request processed in 199us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.552682:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788521519.552736:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521519.552817:0:15113:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788521519.552827:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788521519.561169:0:15136:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788521519.561185:0:15136:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c0a75c48000) 00000020:00000080:1.0:1788521519.561205:0:15136:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788521519.561271:0:15136:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a79c76000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521519.561274:0:15136:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a79c76000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788521519.561276:0:15136:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a79c76000 3 00010000:00080000:1.0:1788521519.561301:0:15136:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0a7b9e6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1788521519.564223:0:15136:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788521519.564899:0:15136:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788521519.566025:0:15136:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788521519.566038:0:15136:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x53df1cebae0174c1 00000100:00080000:1.0:1788521519.566048:0:15136:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788521519.566055:0:15136:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0a7b9e6800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1788521519.566090:0:15136:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a7f31fb80 x1875400368156544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521519.566128:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875400368156544:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788521519.566214:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521519.566270:0:15136:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788521519.572001:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156544 00000100:00100000:3.0:1788521519.572015:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156544 00000100:00100000:3.0:1788521519.572060:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521519.572068:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875400368156544:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788521519.572098:0:14433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:3.0:1788521519.572139:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x53df1cebae0174c8 00000004:00100000:3.0:1788521519.572156:0:14433:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788521519.572186:0:14433:0:(import.c:65:import_set_state_nolock()) ffff8c0a4f90e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521519.572276:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1875400368156544:12345-0@lo:38:llog_process_th.0 Request processed in 208us (6062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.572284:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788521519.572308:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521519.572312:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521519.572315:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521519.572318:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:3.0:1788521519.572399:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0a7f31fb80 x1875400368156544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521519.572410:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788521519.572417:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788521519.572424:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788521519.572429:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788521519.572431:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a7b9e6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788521519.572436:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1875400368156544:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788521519.572470:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368156672:0@lo:400:kworker.0 00000100:00100000:3.0:1788521519.572504:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521519.572545:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156672 00000100:00100000:3.0:1788521519.572549:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156672 00000100:00100000:3.0:1788521519.572574:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521519.572579:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368156672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521519.572612:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1875400368156672:12345-0@lo:400:kworker.0 Request processed in 33us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.572618:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788521519.572642:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c0a6ddc8700 x1875400368156672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521519.572651:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1875400368156672:0@lo:400:kworker.0 00000040:00080000:2.0:1788521519.574147:0:15136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788521519.574970:0:15113:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788521519.575008:0:15113:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521519.575022:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174b3 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.575034:0:15113:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575a200/0x53df1cebae0174ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174b3 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788521519.575097:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788521519.575099:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788521519.575101:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521519.575102:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521519.575103:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521519.575105:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521519.575106:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521519.575109:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521519.575110:0:15113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521519.575113:0:15113:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788521519.575116:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788521519.575117:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788521519.575119:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521519.575120:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521519.575121:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521519.575122:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521519.575123:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521519.575124:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521519.575125:0:15113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521519.575150:0:15113:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788521519.575167:0:15113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521519.575228:0:15113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.575265:0:15113:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f7a3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521519.576303:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156800 00000100:00100000:3.0:1788521519.576312:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156800 00000100:00100000:3.0:1788521519.576365:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788521519.576375:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15113:x1875400368156800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788521519.576402:0:14427:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788521519.576421:0:14427:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788521519.703858:0:14427:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788521519.703869:0:14427:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788521519.703940:0:14447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788521519.703945:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788521519.703967:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.703986:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017435 expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.704012:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.704051:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae017435 expref: 16 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.704066:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae017435 expref: 16 pid: 14427 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521519.704079:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1875400368156928:0@lo:104: 00000100:00100000:0.0:1788521519.704145:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521519.704208:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a710b4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521519.704392:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368156928 00000100:00100000:2.0:1788521519.704400:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368156928 00000100:00100000:2.0:1788521519.704441:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521519.704450:0:14416:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788521519.704451:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14447:x1875400368156928:12345-0@lo:104: 00000100:00100000:1.0:1788521519.704462:0:14416:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788521519.704468:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521519.704943:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788521519.704951:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14447:x1875400368156928:12345-0@lo:104: Request processed in 502us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521519.704959:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788521519.706506:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521519.706515:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.706524:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0200 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521519.706531:0:14421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.706541:0:14421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521519.706547:0:14421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521519.706553:0:14421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521519.706592:0:14421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.706614:0:14421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521519.706646:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.706657:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0200/0x53df1cebae017435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae01743c expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521519.706679:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521519.706680:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521519.706682:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521519.706707:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1875400368156928:0@lo:104: 00010000:00010000:1.0:1788521519.706729:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521519.706833:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368157056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521519.706885:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521519.707090:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157056 00000100:00100000:1.0:1788521519.707097:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157056 00010000:00010000:1.0:1788521519.707120:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae017435 expref: 17 pid: 14427 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521519.707166:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788521519.707174:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:3302:x1875400368157056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521519.707186:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521519.707206:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae017435 expref: 17 pid: 14427 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707220:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae017435 expref: 17 pid: 14427 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707236:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01743c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae017435 expref: 17 pid: 14427 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707251:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707261:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788521519.707275:0:14419:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003329892s 00010000:00010000:1.0:1788521519.707280:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707287:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707295:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707302:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707544:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6ec00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521519.707550:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707559:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707581:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521519.707592:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521519.707636:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:3302:x1875400368157056:12345-0@lo:103:ldlm_bl.0 Request processed in 462us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521519.707644:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521519.707724:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368157056:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521519.707805:0:14447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521519.707815:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521519.707823:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae0174cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521519.745205:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:15113:x1875400368156800:12345-0@lo:253:mount.lustre.0 Request processed in 168817us (169963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521519.745471:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788521519.745661:0:15113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15113:1875400368156800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788521519.745684:0:15113:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788521519.745690:0:15113:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788521519.745692:0:15113:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788521519.745693:0:15113:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521519.745697:0:15113:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521519.745698:0:15113:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521519.745700:0:15113:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521519.745701:0:15113:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521519.745706:0:15113:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521519.745707:0:15113:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788521519.746194:0:15113:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788521519.763438:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521519.763600:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521519.764184:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521519.764327:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521519.764472:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521519.765935:0:15113:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788521519.767637:0:15113:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788521519.892219:0:15113:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788521519.892227:0:15113:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788521519.892264:0:15113:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788521519.892317:0:15113:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788521519.892330:0:15113:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788521519.892358:0:15113:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788521520.234909:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788521520.808861:0:14429:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788521520.808869:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c09434dd000 from 7 10000000:01000000:2.0:1788521520.808875:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788521520.808935:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521520.808958:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521520.808971:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521520.808996:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368157184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521520.809064:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521520.809124:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521520.809249:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157184 00000100:00100000:0.0:1788521520.809257:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157184 00000100:00100000:0.0:1788521520.809304:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788521520.809313:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+15:14429:x1875400368157184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521520.809333:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521520.809347:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0174d6 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521520.809370:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521520.809381:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 16 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521520.809389:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6f200, rc 0) 00000100:00100000:0.0:1788521520.809447:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:14429:x1875400368157184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521520.809455:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788521520.809726:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368157184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521520.809742:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521520.809751:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521520.809826:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368157312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788521520.809863:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521520.809884:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521520.810008:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157312 00000100:00100000:0.0:1788521520.810013:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157312 00000100:00100000:0.0:1788521520.810048:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788521520.810055:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:14429:x1875400368157312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788521520.810069:0:14427:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788521520.810084:0:14427:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788521520.810088:0:14427:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788521520.810165:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:14429:x1875400368157312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521520.810172:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788521520.810241:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368157312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788521520.810301:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521520.810313:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521520.810321:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521521.257400:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521522.280868:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521523.327061:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521524.332235:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521524.841930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521524.841937:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521524.841939:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521524.841942:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788521524.841994:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368157568:0@lo:400:kworker.0 00000100:00100000:3.0:1788521524.842060:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521524.842116:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521524.842134:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368157696:0@lo:400:kworker.0 00000100:00100000:3.0:1788521524.842158:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521524.842197:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157568 00000100:00100000:3.0:1788521524.842204:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157568 00000100:00100000:3.0:1788521524.842245:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157696 00000100:00100000:3.0:1788521524.842248:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157696 00000100:00100000:3.0:1788521524.842270:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521524.842277:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368157568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521524.842324:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368157568:12345-0@lo:400:kworker.0 Request processed in 47us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521524.842331:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521524.842347:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521524.842353:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368157696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521524.842380:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368157696:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521524.842386:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788521524.842421:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a6ddc9c00 x1875400368157696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521524.842436:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368157696:0@lo:400:kworker.0 00010000:00080000:3.0:1788521524.842448:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a6ddc8380 x1875400368157568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521524.842456:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368157568:0@lo:400:kworker.0 00000100:00100000:1.0:1788521524.842513:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521524.842522:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368157440:0@lo:400:kworker.0 00000100:00100000:1.0:1788521524.842555:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521524.842620:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157440 00000100:00100000:3.0:1788521524.842624:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157440 00000100:00080000:2.0:1788521524.842757:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521524.843613:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788521524.843626:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:3302:x1875400368157440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521524.843696:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:3302:x1875400368157440:12345-0@lo:400:kworker.0 Request processed in 74us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521524.843704:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788521524.843845:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368157440:0@lo:400:kworker.0 00010000:00010000:3.0:1788521525.355635:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788521526.362306:0:15482:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788521526.377523:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521527.403713:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521527.786669:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521528.431478:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521529.449290:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788521529.961012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521529.961019:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788521529.961022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788521529.961025:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788521529.961135:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368157952:0@lo:400:kworker.0 00000100:00100000:2.0:1788521529.961205:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368157824:0@lo:400:kworker.0 00000100:00100000:0.0:1788521529.961210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521529.961312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521529.961373:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157952 00000100:00100000:3.0:1788521529.961381:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157952 00000100:00100000:3.0:1788521529.961435:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521529.961450:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368157952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521529.961524:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368157952:12345-0@lo:400:kworker.0 Request processed in 81us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521529.961534:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521529.961565:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368158080:0@lo:400:kworker.0 00000100:00100000:3.0:1788521529.961655:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521529.961703:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158080 00000100:00100000:3.0:1788521529.961708:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158080 00000100:00100000:3.0:1788521529.961750:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521529.961758:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368158080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521529.961828:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368158080:12345-0@lo:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521529.961863:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788521529.961888:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521529.961920:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a6ddcb100 x1875400368158080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521529.961934:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368158080:0@lo:400:kworker.0 00010000:00080000:3.0:1788521529.961974:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a6ddc9c00 x1875400368157952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521529.961985:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368157952:0@lo:400:kworker.0 00000100:00100000:0.0:1788521529.974615:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368157824 00000100:00100000:0.0:1788521529.974637:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368157824 00000100:00100000:0.0:1788521529.974714:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521529.974726:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:3302:x1875400368157824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521529.974886:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:3302:x1875400368157824:12345-0@lo:400:kworker.0 Request processed in 162us (13577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521529.974894:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788521529.974985:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368157824:0@lo:400:kworker.0 00010000:00010000:3.0:1788521530.473494:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521530.857243:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521515/real 1788521515] req@ffff8c0a6ddcb800 x1875400368154112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521530.857285:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c0a6ddcb800 x1875400368154112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521530.857297:0:3299:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788521515/real 1788521515] req@ffff8c0941357800 x1875400368153856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521530.857311:0:3299:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c0941357800 x1875400368153856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788521530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788521530.857334:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a47c27000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521530.857358:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788521530.857362:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368154112:0@lo:8:kworker.0 00000100:00080000:1.0:1788521530.857369:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521530.857374:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788521530.857377:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368153856:0@lo:8:kworker.0 00000100:00080000:2.0:1788521530.857412:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521530.857417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788521530.857420:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c0a47c27000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521530.857426:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1788521530.857432:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788521530.857440:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c0a47c27000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521530.857483:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0941356680 x1875400368158208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788521530.857509:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521530.857512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788521530.857513:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521530.857517:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1788521530.857520:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788521530.857523:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0a60446800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521530.857536:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0941354a80 x1875400368158336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788521530.857818:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368158208:0@lo:8:kworker.0 00000100:00100000:1.0:1788521530.857922:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521530.858063:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368158336:0@lo:8:kworker.0 00000100:00100000:1.0:1788521530.858090:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521530.858159:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158208 00000100:00100000:3.0:1788521530.858170:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158208 00000100:00100000:3.0:1788521530.858209:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158336 00000100:00100000:3.0:1788521530.858213:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158336 00000100:00100000:3.0:1788521530.858227:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521530.858235:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875400368158208:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788521530.858278:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:3.0:1788521530.858315:0:15114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae0174e4 00002000:00100000:3.0:1788521530.858332:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c0a4f90d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788521530.858337:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788521530.858340:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788521530.858769:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788521530.858848:0:15114:0:(import.c:65:import_set_state_nolock()) ffff8c0a4f90b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521530.858921:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875400368158208:12345-0@lo:8:kworker.0 Request processed in 685us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521530.858930:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788521530.858959:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521530.858965:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875400368158336:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788521530.858978:0:15114:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788521530.859014:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875400368158336:12345-0@lo:8:kworker.0 Request processed in 48us (923us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788521530.859020:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788521530.859088:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0941356680 x1875400368158208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521530.859099:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788521530.859109:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788521530.859119:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788521530.859125:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788521530.859128:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a47c27000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788521530.859149:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788521530.859156:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368158208:0@lo:8:kworker.0 00000100:00080000:1.0:1788521530.859170:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788521530.859174:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788521530.859178:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368158336:0@lo:8:kworker.0 00000004:00080000:1.0:1788521530.859208:0:14453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788521530.859273:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368158464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521530.859313:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788521530.859368:0:14454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788521530.859389:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1875400368158592:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788521530.859420:0:14454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521530.859435:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51600 going to sleep for 11 seconds 00000004:00080000:1.0:1788521530.859487:0:14453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 451937712487ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788521530.859530:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158592 00000100:00100000:0.0:1788521530.859532:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158464 00000100:00100000:1.0:1788521530.859535:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158592 00000100:00100000:0.0:1788521530.859536:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158464 00000100:00100000:1.0:1788521530.859578:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521530.860128:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788521530.860146:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368158464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521530.860175:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521530.863280:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14454:x1875400368158592:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788521530.863317:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788521530.872509:0:15117:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788521530.872523:0:15117:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788521530.872530:0:15117:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:0.0:1788521530.877191:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368158464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 17034us (17864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521530.877209:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788521530.880834:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a6ddc9c00 x1875400368158464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521530.880873:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368158464:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788521530.893341:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.893360:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893381:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.893387:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.893395:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893417:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893430:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893439:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893459:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.893475:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.893482:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893491:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575be00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.893496:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893506:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893533:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893541:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae0174eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.893560:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.893562:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.893564:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.894396:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.894405:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894418:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.894422:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.894428:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894441:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894451:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894461:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894492:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.894506:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.894511:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894520:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.894524:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894533:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894546:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894554:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae0174f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.894570:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.894572:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.894573:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.895034:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.895041:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895051:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.895060:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.895065:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895076:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895085:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895093:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895111:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.895122:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.895127:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895134:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.895137:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895145:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895156:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895174:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae0174f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895189:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.895191:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.895193:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.895582:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.895588:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895597:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.895600:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.895604:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895613:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895621:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895628:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895644:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.895652:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.895661:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895668:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.895672:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895680:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895690:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895697:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017500 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.895710:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.895712:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.895713:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.905901:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.905919:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.905953:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.905960:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.907860:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.907924:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.908519:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.908536:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.908592:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521530.910246:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521530.910266:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.910282:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575be00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.910288:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.910302:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.910337:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.910347:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017507 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.910398:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.910400:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.910402:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.911761:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.911798:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.911817:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.911823:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.911842:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.911858:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.911869:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.911891:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.911910:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.911926:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.911933:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.911940:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ba00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.911956:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.914202:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.914245:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.914255:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae01750e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.914283:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.914286:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.914288:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.915717:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.915742:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.915761:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.915767:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.916172:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916192:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916203:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916211:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916277:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521530.916900:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.916908:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916920:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.916923:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.916928:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916937:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916971:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.916979:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918100:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521530.918115:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918129:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.918136:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918147:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918171:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918178:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017515 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918208:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521530.918211:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918217:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.918235:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918243:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918254:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.918261:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.918263:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.918265:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.918422:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788521530.918430:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01751c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521530.919404:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.919414:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.919429:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.919433:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.919441:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.919455:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.919466:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.919485:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.919543:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521530.919550:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.919558:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.919563:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.919572:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.919585:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.919595:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.919602:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.919605:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.919707:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788521530.919714:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017523 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521530.920576:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.920584:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920598:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.920601:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.920607:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920620:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920629:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920637:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920671:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.920685:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.920690:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920697:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.920701:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920711:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920725:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920732:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01752a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.920748:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.920749:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.920751:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.920915:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.924414:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.924431:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.924452:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1788521530.924464:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.924472:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.924491:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.924503:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.924512:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788521530.928261:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1788521530.929762:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521530.930622:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.930635:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.930657:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.930662:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.930670:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.930691:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.930704:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.930720:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938535:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521530.938554:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938573:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ba00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.938579:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938592:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938619:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938627:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938650:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521530.938654:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938661:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ac00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.938664:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938686:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938696:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.938705:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.938707:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.938709:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.938807:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788521530.938816:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae017538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.939040:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521530.943176:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.943196:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.943218:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.943223:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.943231:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.943248:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.943260:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.943268:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.943302:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521530.945586:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.945601:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.945622:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.945626:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.945633:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.945648:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.945659:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.945668:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.945685:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788521530.946493:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.946502:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.946514:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.946525:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.946530:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.946542:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.946552:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.946559:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.946568:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788521530.950731:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521530.950749:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.950765:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.950797:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521530.953178:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.953199:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.953221:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.953227:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.953236:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.953256:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.953268:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.953295:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.953310:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788521530.953706:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.953734:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.953743:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad32d03c/0x53df1cebae01753f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521530.954106:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.954115:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954126:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.954129:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.954133:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954143:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954151:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954158:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954167:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1788521530.954538:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.954545:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954559:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.954562:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.954566:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954577:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954585:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954592:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.954600:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1788521530.955030:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.955037:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955046:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.955049:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.955053:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955064:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955086:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955092:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955101:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1788521530.955463:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521530.955469:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955478:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=452s v=(0 0) 00010000:00010000:1.0:1788521530.955481:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521530.955485:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955493:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955501:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955509:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.955531:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1788521530.958652:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788521530.958948:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788521530.958957:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.958969:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.958974:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.958985:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959004:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959013:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2337e4e/0x53df1cebae01754d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959026:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788521530.959030:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959038:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ba00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.959041:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959081:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959093:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959102:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bbd98bb/0x53df1cebae017554 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959115:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788521530.959119:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959125:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ac00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.959128:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959136:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959279:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959288:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3ed735d/0x53df1cebae01755b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959312:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788521530.959316:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959322:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.959325:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959332:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959341:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959651:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018c82006/0x53df1cebae017562 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959681:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788521530.959686:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959693:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575be00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.959698:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959725:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959743:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959750:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063063df1/0x53df1cebae017569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959765:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521530.959769:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959799:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.959802:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959810:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959820:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959836:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061eaf99c/0x53df1cebae017570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.959861:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.959863:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.959865:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.960525:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.960536:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.960562:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.960568:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.960576:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.963133:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.963152:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.963160:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.966585:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521530.967201:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521530.967214:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.967230:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.967236:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.967249:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.967276:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.967284:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b64b154/0x53df1cebae017577 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.967308:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.967310:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.967312:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.968210:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.968221:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.968244:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521530.968247:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.968256:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.968270:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.968276:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000329ad51f/0x53df1cebae017546 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521530.968293:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.968295:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.968297:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.968301:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521530.968303:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.971443:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.971461:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.971481:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.971487:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.971494:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.971511:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.971534:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.971542:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.971572:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.971726:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.971735:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.971744:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.971749:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.971759:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.971804:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.971814:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae01757e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.971844:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.971846:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.971848:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.976389:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.976407:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976428:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.976434:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.976440:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976457:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976468:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976476:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976509:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521530.976524:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521530.976530:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976538:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521530.976543:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976554:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976578:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976585:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bc5b6b/0x53df1cebae017585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.976604:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521530.976606:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521530.976608:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.979464:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.979484:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.979504:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.979515:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.979523:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.979541:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.979554:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.979563:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.979596:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521530.980154:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521530.980164:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.980174:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0e00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521530.980180:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.980191:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.980213:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.980221:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a20171/0x53df1cebae01758c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.980242:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521530.980244:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521530.980245:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.982446:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.982468:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.982488:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.982494:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.982501:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.982517:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.982528:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.982543:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.982576:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521530.984093:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521530.984109:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.984125:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1a00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521530.984155:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.984166:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.984188:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.984196:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c205f69/0x53df1cebae017593 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521530.984224:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.984226:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521530.984227:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.984446:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.984455:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984469:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.984473:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.984479:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984492:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984501:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984510:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984529:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521530.984540:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521530.984545:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984557:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521530.984560:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984568:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984579:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984586:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039275c70/0x53df1cebae01759a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.984598:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521530.984600:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521530.984602:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788521530.986305:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.986319:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.986336:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.986340:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.986347:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.986361:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.986379:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.986387:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.986460:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788521530.987030:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788521530.987036:0:15117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.987046:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=452s v=(0 0) 00010000:00010000:2.0:1788521530.987049:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521530.987053:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.987063:0:15117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.987070:0:15117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521530.987078:0:15117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987613:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788521530.987622:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987633:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521530.987638:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987648:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987667:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987675:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f57e8de2/0x53df1cebae0175a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987697:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521530.987700:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987706:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521530.987709:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987717:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987741:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521530.987749:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521530.987751:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521530.987753:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521530.990278:0:15117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788521530.990299:0:15117:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067f37612/0x53df1cebae0175a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788521530.990753:0:15117:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788521530.990906:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14454:x1875400368158592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 131316us (131479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521530.990922:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788521530.991157:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1875400368158592:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788521530.991176:0:14454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788521530.991233:0:14454:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1875400368158720:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788521530.991275:0:14454:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521530.991323:0:14454:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51600 going to sleep for 11 seconds 00000100:00100000:2.0:1788521530.991380:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158720 00000100:00100000:2.0:1788521530.991389:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158720 00000100:00100000:2.0:1788521530.991443:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521530.991454:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14454:x1875400368158720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788521530.991508:0:15116:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788521530.993202:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521531.004720:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14454:x1875400368158720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13257us (13433us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788521531.004735:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521531.005192:0:14454:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14454:1875400368158720:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788521531.005214:0:14454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788521531.496920:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521532.522074:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521533.557190:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788521534.095890:0:15834:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788521534.095895:0:15834:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788521534.096074:0:15834:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c0a5104d800 00000020:01000004:2.0:1788521534.096097:0:15834:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788521534.096116:0:15834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788521534.096134:0:15834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c0a76e64d40) 00000020:00000080:2.0:1788521534.096168:0:15834:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788521534.129823:0:15834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788521534.130627:0:15834:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788521534.134920:0:15834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788521534.135186:0:15834:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788521534.135448:0:15834:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788521534.135876:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 429: rc = 0 00100000:10000000:2.0:1788521534.136021:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 429: rc = 0 00100000:10000000:2.0:1788521534.136124:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 429: rc = 0 00100000:10000000:2.0:1788521534.141816:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 496: rc = 0 00100000:10000000:2.0:1788521534.144197:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 496: rc = 0 00100000:10000000:2.0:1788521534.147932:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 496: rc = 0 00100000:10000000:2.0:1788521534.148467:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 496: rc = 0 00100000:10000000:2.0:1788521534.148756:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 496: rc = 0 00100000:10000000:2.0:1788521534.149395:0:15834:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 496: rc = 0 00000020:00000080:2.0:1788521534.151156:0:15834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788521534.151174:0:15834:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788521534.151190:0:15834:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x53df1cebae0175b6 00000020:01000004:2.0:1788521534.151201:0:15834:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788521534.151230:0:15834:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788521534.151234:0:15834:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788521534.151241:0:15834:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788521534.151267:0:15834:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788521534.151272:0:15834:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788521534.169698:0:15834:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788521534.169762:0:15834:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788521534.169768:0:15834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788521534.169770:0:15834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521534.169794:0:15834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521534.169796:0:15834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521534.169797:0:15834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521534.169799:0:15834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521534.169801:0:15834:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521534.169813:0:15834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521534.169815:0:15834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521534.169819:0:15834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788521534.169822:0:15834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788521534.169823:0:15834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788521534.169824:0:15834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788521534.169825:0:15834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788521534.169826:0:15834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788521534.169828:0:15834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788521534.169829:0:15834:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788521534.169830:0:15834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788521534.169831:0:15834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788521534.169867:0:15834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788521534.169893:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368158848:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788521534.173271:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521534.173459:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a65dd2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.175106:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158848 00000100:00100000:1.0:1788521534.175127:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158848 00000100:00100000:1.0:1788521534.175264:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788521534.175277:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15834:x1875400368158848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788521534.175351:0:14424:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788521534.175355:0:14424:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788521534.175359:0:14424:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788521534.200389:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15834:x1875400368158848:12345-0@lo:253:mount.lustre.0 Request processed in 25101us (27115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.200410:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788521534.200555:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368158848:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788521534.200577:0:15834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788521534.200581:0:15834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788521534.200583:0:15834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788521534.200584:0:15834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788521534.200585:0:15834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788521534.200587:0:15834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788521534.200589:0:15834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788521534.200590:0:15834:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788521534.200593:0:15834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788521534.200595:0:15834:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788521534.200632:0:15834:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0a5104d800 from lustre-OST0001 10000000:01000000:0.0:1788521534.200666:0:15834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788521534.200670:0:15834:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788521534.200680:0:15834:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c0941330000 local copy 00010000:00010000:0.0:1788521534.200693:0:15834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521534.201193:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368158976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521534.201245:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521534.201297:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dcc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.201378:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368158976 00000100:00100000:1.0:1788521534.201387:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368158976 00000100:00100000:1.0:1788521534.201441:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788521534.201452:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15834:x1875400368158976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521534.201658:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15834:x1875400368158976:12345-0@lo:501:mount.lustre.0 Request processed in 207us (411us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788521534.201675:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788521534.201821:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368158976:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788521534.201838:0:15834:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788521534.202171:0:15834:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788521534.202181:0:15834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521534.202203:0:15834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ae00/0x53df1cebae01735c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017363 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521534.202231:0:15834:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0a5104d800 10000000:01000000:3.0:1788521534.202236:0:15834:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788521534.202243:0:15834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788521534.202245:0:15834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788521534.202250:0:15834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788521534.202253:0:15834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788521534.202286:0:15834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521534.202294:0:15834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521534.202305:0:15834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521534.202322:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159104:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788521534.202364:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521534.202445:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51300 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.204299:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159104 00000100:00100000:1.0:1788521534.204317:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159104 00000100:00100000:1.0:1788521534.204437:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788521534.204450:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:15834:x1875400368159104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788521534.204470:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521534.204493:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a7575b000/0x53df1cebae0175c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0175bd expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521534.204526:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575b000/0x53df1cebae0175c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0175bd expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521534.204539:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a7575b000/0x53df1cebae0175c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0175bd expref: 17 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521534.204551:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575b000, rc 0) 00000100:00100000:1.0:1788521534.204640:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159104:12345-0@lo:101:mount.lustre.0 Request processed in 194us (2275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.204647:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788521534.204792:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159104:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788521534.204825:0:15834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175c4 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521534.204837:0:15834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0175c4 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788521534.208503:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788521534.209661:0:15834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788521534.210029:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788521534.217338:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788521534.217492:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788521534.217987:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788521534.218032:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788521534.218905:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788521534.219032:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788521534.219043:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788521534.219630:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521534.219699:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521534.219757:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.220063:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159232 00000100:00100000:1.0:1788521534.220080:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159232 00000100:00100000:1.0:1788521534.220149:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788521534.220160:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521534.220572:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159232:12345-0@lo:501:mount.lustre.0 Request processed in 413us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.220581:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788521534.221001:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521534.221037:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521534.221077:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521534.221109:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c51f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.221354:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159360 00000100:00100000:1.0:1788521534.221365:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159360 00000100:00100000:1.0:1788521534.221401:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788521534.221409:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788521534.222982:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159360:12345-0@lo:503:mount.lustre.0 Request processed in 1568us (1899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.222992:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788521534.223289:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788521534.228510:0:15834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788521534.229743:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521534.229862:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521534.229908:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788521534.230799:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159488 00000100:00100000:3.0:1788521534.230819:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159488 00000100:00100000:3.0:1788521534.230873:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788521534.230883:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521534.231634:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75515c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159488:12345-0@lo:502:mount.lustre.0 Request processed in 742us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.231652:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788521534.231684:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788521534.232047:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788521534.232106:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788521534.232154:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788521534.232205:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788521534.232244:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788521534.232281:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788521534.232332:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788521534.232561:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788521534.232631:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788521534.232671:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521534.232736:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521534.232797:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521534.233291:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159616 00000100:00100000:2.0:1788521534.233306:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159616 00000100:00100000:2.0:1788521534.233376:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788521534.233400:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521534.233736:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75515450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159616:12345-0@lo:502:mount.lustre.0 Request processed in 338us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.233746:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788521534.233830:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788521534.233948:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788521534.233959:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788521534.237061:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788521534.237084:0:15835:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788521534.237092:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.237094:0:15835:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788521534.237102:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788521534.237117:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c0a75c4b380) 00000020:00000080:1.0:1788521534.237152:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788521534.237159:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788521534.237252:0:15835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a5104d800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788521534.237259:0:15835:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788521534.237267:0:15835:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x53df1cebae0175d2 00010000:00010000:1.0:1788521534.247321:0:15835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788521534.247996:0:15835:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788521534.253815:0:15835:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788521534.257872:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788521534.257884:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521534.257903:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.257906:0:15835:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788521534.257910:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521534.257915:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.257917:0:15835:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788521534.257920:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788521534.257922:0:15835:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788521534.257925:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521534.257927:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.257929:0:15835:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788521534.257931:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521534.257933:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.257935:0:15835:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788521534.257938:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788521534.258000:0:15835:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521534.258004:0:15835:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.258005:0:15835:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788521534.258008:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788521534.262288:0:15834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788521534.262348:0:15834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788521534.262402:0:15834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175c4 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.262415:0:15834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a40030c00/0x53df1cebae0175bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175c4 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521534.262424:0:15834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a5104d800 from 1 10000000:01000000:2.0:1788521534.262427:0:15834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521534.262463:0:15834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.262471:0:15834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.262481:0:15834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521534.262504:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521534.262691:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.262740:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a5807c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521534.262826:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159744 00000100:00100000:0.0:1788521534.262834:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159744 00000100:00100000:0.0:1788521534.262886:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788521534.262895:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:15834:x1875400368159744:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788521534.262908:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521534.262920:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0175d9 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.262944:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.262956:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.262965:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e200, rc 0) 00000100:00100000:0.0:1788521534.263003:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368159744:12345-0@lo:101:mount.lustre.0 Request processed in 109us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.263020:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788521534.263116:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521534.263613:0:15834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.263632:0:15834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521534.264476:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788521534.265918:0:15834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521534.266318:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788521534.266485:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788521534.266628:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788521534.266636:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788521534.266727:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521534.266820:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.266873:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a5807c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521534.269506:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368159872 00000100:00100000:0.0:1788521534.269528:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368159872 00000100:00100000:0.0:1788521534.269590:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788521534.269599:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368159872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788521534.269910:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75515050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368159872:12345-0@lo:501:mount.lustre.0 Request processed in 312us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.269918:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788521534.271272:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368159872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521534.271330:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788521534.271405:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.271447:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a5807c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521534.271916:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160000 00000100:00100000:0.0:1788521534.271923:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160000 00000100:00100000:0.0:1788521534.271972:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788521534.271981:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788521534.272197:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75517850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160000:12345-0@lo:503:mount.lustre.0 Request processed in 216us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.272205:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788521534.273695:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788521534.274755:0:15834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788521534.274897:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521534.274973:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.275019:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.275370:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160128 00000100:00100000:1.0:1788521534.275377:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160128 00000100:00100000:1.0:1788521534.275425:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788521534.275434:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521534.275848:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75517c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160128:12345-0@lo:502:mount.lustre.0 Request processed in 415us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.275856:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788521534.275976:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521534.276471:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788521534.276583:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788521534.276640:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788521534.276677:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788521534.276703:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788521534.276747:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788521534.277326:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788521534.277428:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788521534.277465:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521534.277584:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.278636:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a5807c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521534.279887:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160256 00000100:00100000:0.0:1788521534.279898:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160256 00000100:00100000:0.0:1788521534.279952:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788521534.279961:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521534.280490:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75515850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160256:12345-0@lo:502:mount.lustre.0 Request processed in 528us (2905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.280499:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788521534.282048:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521534.282501:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788521534.282586:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788521534.284479:0:15839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521534.284492:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.284494:0:15839:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788521534.284504:0:15839:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a5104d800 00000020:00000080:1.0:1788521534.284507:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788521534.284586:0:15839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521534.284591:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.284600:0:15839:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788521534.284604:0:15839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521534.284607:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.284609:0:15839:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788521534.284625:0:15839:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0a5104d800 00000020:00000080:1.0:1788521534.284627:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788521534.284728:0:15839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788521534.284732:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.284733:0:15839:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788521534.284736:0:15839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788521534.284739:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788521534.284740:0:15839:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788521534.284744:0:15839:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c0a5104d800 00000020:00000080:1.0:1788521534.284746:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788521534.285429:0:15839:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788521534.285435:0:15839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788521534.285437:0:15839:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788521534.285442:0:15839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788521534.292500:0:15834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788521534.293284:0:15834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788521534.294692:0:15834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.294710:0:15834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788521534.294766:0:15834:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788521534.294769:0:15834:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0a5104d800 10000000:01000000:2.0:1788521534.294787:0:15834:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0a5104d800 10000000:01000000:2.0:1788521534.294792:0:15834:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788521534.294798:0:15834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8c0a5104d800 from 1 10000000:01000000:2.0:1788521534.294810:0:15834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788521534.294845:0:15834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.294854:0:15834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.294866:0:15834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521534.294901:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788521534.294966:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.295018:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160384 00000100:00100000:2.0:1788521534.295024:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160384 00000100:00100000:2.0:1788521534.295062:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521534.295077:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368160384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521534.295091:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521534.295104:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a1400/0x53df1cebae0175ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae0175e7 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.295138:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a1400/0x53df1cebae0175ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae0175e7 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.295150:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a1400/0x53df1cebae0175ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0175e7 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.295159:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1400, rc 0) 00000100:00100000:2.0:1788521534.295193:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160384:12345-0@lo:101:mount.lustre.0 Request processed in 123us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.295198:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788521534.295244:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788521534.295266:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788521534.295281:0:15834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175ee expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.295291:0:15834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae0175ee expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788521534.297883:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788521534.300501:0:15834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788521534.301011:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788521534.301836:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788521534.301886:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788521534.301941:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788521534.301976:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788521534.302034:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788521534.304554:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788521534.304645:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788521534.304724:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788521534.304763:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788521534.304839:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788521534.304891:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788521534.304930:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788521534.304964:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788521534.305010:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788521534.305047:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788521534.305096:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788521534.305415:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788521534.305474:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788521534.305690:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788521534.305760:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788521534.305837:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788521534.305875:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788521534.305928:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788521534.305965:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788521534.306002:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788521534.306053:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788521534.307507:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788521534.307569:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788521534.307653:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788521534.307693:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788521534.307730:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788521534.307765:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788521534.307880:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788521534.307920:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788521534.307969:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788521534.308002:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788521534.308905:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788521534.308918:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788521534.309020:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788521534.309612:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.309702:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.329679:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160512 00000100:00100000:1.0:1788521534.329696:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160512 00000100:00100000:1.0:1788521534.329862:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788521534.329873:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788521534.331949:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160512:12345-0@lo:501:mount.lustre.0 Request processed in 2070us (22330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.331962:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788521534.332502:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788521534.332643:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521534.332696:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521534.332735:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c519c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521534.332822:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160640 00000100:00100000:3.0:1788521534.332828:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160640 00000100:00100000:3.0:1788521534.332870:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521534.332880:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788521534.333054:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160640:12345-0@lo:503:mount.lustre.0 Request processed in 175us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.333062:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788521534.333118:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788521534.335827:0:15834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788521534.335909:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788521534.335977:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521534.336013:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a68c519c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521534.337106:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160768 00000100:00100000:1.0:1788521534.337115:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160768 00000100:00100000:1.0:1788521534.337169:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788521534.337178:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160768:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788521534.337682:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160768:12345-0@lo:502:mount.lustre.0 Request processed in 503us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.337690:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788521534.337810:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160768:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788521534.338233:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788521534.338292:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788521534.338324:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788521534.338441:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788521534.338475:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788521534.338652:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788521534.338694:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788521534.338727:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788521534.338818:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788521534.338857:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788521534.338892:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788521534.338959:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788521534.338994:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788521534.339037:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788521534.340746:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788521534.340859:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788521534.340895:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788521534.340972:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788521534.341009:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788521534.341042:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788521534.341087:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788521534.341122:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788521534.342752:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788521534.343414:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788521534.343463:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788521534.343498:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788521534.343947:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788521534.343985:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788521534.344017:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788521534.345538:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788521534.345751:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788521534.345826:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788521534.345863:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788521534.345916:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788521534.345950:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788521534.345994:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788521534.346028:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788521534.346059:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788521534.346104:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788521534.346138:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788521534.346188:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941354380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788521534.346276:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.346319:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a70fbc3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521534.346632:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368160896 00000100:00100000:0.0:1788521534.346641:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368160896 00000100:00100000:0.0:1788521534.346722:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788521534.346731:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160896:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788521534.353669:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368160896:12345-0@lo:502:mount.lustre.0 Request processed in 6927us (7381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.353685:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788521534.353828:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941354380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368160896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788521534.353974:0:15834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788521534.353991:0:15834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788521534.359710:0:15844:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788521534.359728:0:15844:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c0a458e99c0) 00000020:00000080:3.0:1788521534.359753:0:15844:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788521534.359867:0:15844:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0a5104d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788521534.359871:0:15844:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0a5104d800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788521534.359874:0:15844:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8c0a5104d800 3 00010000:00080000:3.0:1788521534.359905:0:15844:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c094131f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1788521534.367587:0:15844:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788521534.368649:0:15844:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788521534.368694:0:15844:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788521534.368705:0:15844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x53df1cebae0175fc 00000100:00080000:0.0:1788521534.368718:0:15844:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788521534.368725:0:15844:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c094131f000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1788521534.368765:0:15844:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a75b0d180 x1875400368161024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788521534.369455:0:15844:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788521534.370477:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368161024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788521534.370575:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521534.371453:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161024 00000100:00100000:0.0:1788521534.371467:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161024 00000100:00100000:0.0:1788521534.371523:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521534.371530:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1875400368161024:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788521534.371559:0:14433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:0.0:1788521534.371597:0:14433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x53df1cebae017603 00000004:00100000:0.0:1788521534.371613:0:14433:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788521534.371647:0:14433:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab82800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521534.371710:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1875400368161024:12345-0@lo:38:llog_process_th.0 Request processed in 179us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.371718:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788521534.371765:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0a75b0d180 x1875400368161024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788521544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788521534.371797:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788521534.371825:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788521534.371834:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788521534.371839:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788521534.371842:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c094131f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788521534.371849:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1875400368161024:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788521534.375579:0:15844:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788521534.375715:0:15834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788521534.375745:0:15834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788521534.375792:0:15834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175ee expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521534.375816:0:15834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a1e00/0x53df1cebae0175e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae0175ee expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788521534.375868:0:15834:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788521534.375870:0:15834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788521534.375872:0:15834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521534.375873:0:15834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521534.375875:0:15834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521534.375876:0:15834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521534.375877:0:15834:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521534.375879:0:15834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521534.375881:0:15834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521534.375884:0:15834:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788521534.375887:0:15834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788521534.375888:0:15834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788521534.375889:0:15834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788521534.375890:0:15834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788521534.375891:0:15834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788521534.375892:0:15834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788521534.375893:0:15834:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788521534.375894:0:15834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788521534.375895:0:15834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788521534.375921:0:15834:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788521534.375941:0:15834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368161152:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788521534.376008:0:15834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521534.376045:0:15834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a6dcaa780 going to sleep for 11 seconds 00000100:00100000:3.0:1788521534.378007:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161152 00000100:00100000:3.0:1788521534.378020:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161152 00000100:00100000:3.0:1788521534.378175:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788521534.378186:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7ac8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:15834:x1875400368161152:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788521534.378219:0:14426:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788521534.378233:0:14426:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1788521534.380343:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788521534.380349:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788521534.380353:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788521534.380361:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1788521534.380366:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788521534.380378:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0a60446800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1788521534.380398:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368161280:0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.380469:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.380526:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161280 00000100:00100000:2.0:1788521534.380533:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161280 00000100:00100000:2.0:1788521534.380586:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521534.380595:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368161280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.380644:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368161280:12345-0@lo:400:kworker.0 Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.380652:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788521534.380670:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521534.380701:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368161280:0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.380735:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0941357100 x1875400368161408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788521534.380756:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368161408:0@lo:8:kworker.0 00000100:00100000:2.0:1788521534.380794:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.380835:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161408 00000100:00100000:2.0:1788521534.380838:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161408 00000100:00100000:2.0:1788521534.380855:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521534.380859:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875400368161408:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788521534.380900:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1875400368161408:12345-0@lo:8:kworker.0 Request processed in 40us (105us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788521534.380906:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788521534.380926:0:3299:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788521534.380932:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788521534.380936:0:3299:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788521534.380945:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368161408:0@lo:8:kworker.0 00000100:00100000:2.0:1788521534.380980:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368161536:0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.381009:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.381041:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161536 00000100:00100000:2.0:1788521534.381044:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161536 00000100:00100000:2.0:1788521534.381068:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788521534.381075:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368161536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.381109:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368161536:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.381115:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788521534.381263:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0941357100 x1875400368161536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521534.381273:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368161536:0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.381307:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368161664:0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.381456:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.381492:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161664 00000100:00100000:2.0:1788521534.381495:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161664 00000100:00100000:2.0:1788521534.381519:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788521534.381525:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788521534.381560:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1875400368161664:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521534.381566:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788521534.381580:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788521534.381597:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c0941357100 x1875400368161664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521534.381618:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1875400368161664:0@lo:400:kworker.0 20000000:01000000:3.0:1788521534.439322:0:14426:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788521534.439410:0:14426:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788521534.440604:0:14447:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788521534.440614:0:14447:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788521534.440637:0:14447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.440656:0:14447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.440665:0:14447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.440705:0:14447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 19 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521534.440720:0:14447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 19 pid: 14426 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521534.440734:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1875400368161792:0@lo:104: 00000100:00100000:2.0:1788521534.440837:0:14447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521534.440878:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a507de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521534.440982:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161792 00000100:00100000:3.0:1788521534.440990:0:14416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161792 00000100:00100000:3.0:1788521534.441040:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521534.441049:0:14416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14447:x1875400368161792:12345-0@lo:104: 00010000:00010000:3.0:1788521534.441061:0:14416:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521534.441233:0:14416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521534.441240:0:14416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941356680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:14447:x1875400368161792:12345-0@lo:104: Request processed in 192us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521534.441248:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788521534.441402:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14447:1875400368161792:0@lo:104: 00010000:00010000:1.0:1788521534.441424:0:14447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.441579:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521534.441587:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.441596:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0000 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:0.0:1788521534.441600:0:14420:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.441609:0:14420:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788521534.441617:0:14420:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521534.441623:0:14420:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788521534.441661:0:14420:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.441668:0:14420:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788521534.441691:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.441699:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae0174d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0174dd expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.441729:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521534.441731:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521534.441733:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521534.441817:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3301:1875400368161920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788521534.441853:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521534.442050:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368161920 00000100:00100000:0.0:1788521534.442056:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368161920 00010000:00010000:0.0:1788521534.442197:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 20 pid: 14426 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521534.442230:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521534.442238:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+20:3301:x1875400368161920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521534.442251:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521534.442256:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 20 pid: 14426 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442267:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 20 pid: 14426 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442282:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a48f6f200/0x53df1cebae0174dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0174d6 expref: 20 pid: 14426 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442297:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442306:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788521534.442323:0:14419:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003329892s 00010000:00010000:0.0:1788521534.442328:0:14419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442425:0:14419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442433:0:14419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442440:0:14419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442447:0:14419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521534.442452:0:14419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442461:0:14419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442481:0:14419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521534.442491:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521534.442528:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941357800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3301:x1875400368161920:12345-0@lo:103:ldlm_bl.0 Request processed in 290us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521534.442535:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788521534.442607:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3301:1875400368161920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521534.442669:0:14447:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521534.442679:0:14447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521534.442686:0:14447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a439a0200/0x53df1cebae01760a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521534.480944:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7ac8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:15834:x1875400368161152:12345-0@lo:253:mount.lustre.0 Request processed in 102752us (104927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521534.480958:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788521534.481456:0:15834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:15834:1875400368161152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788521534.481473:0:15834:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788521534.481476:0:15834:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788521534.481490:0:15834:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788521534.481492:0:15834:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788521534.481493:0:15834:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788521534.481494:0:15834:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788521534.481496:0:15834:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788521534.481498:0:15834:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788521534.481500:0:15834:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788521534.481501:0:15834:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788521534.481517:0:15834:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788521534.489295:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521534.491731:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521534.491953:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521534.492124:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788521534.492272:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788521534.492558:0:15834:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788521534.494098:0:15834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788521534.565613:0:15834:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788521534.565622:0:15834:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788521534.565660:0:15834:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788521534.565717:0:15834:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788521534.565752:0:15834:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788521534.565797:0:15834:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788521534.572111:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788521535.221235:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788521535.221269:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788521535.602614:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788521535.850864:0:14429:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788521535.850870:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8c09434dd000 from 8 10000000:01000000:1.0:1788521535.850875:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788521535.850916:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.850928:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.850939:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521535.850964:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368162048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788521535.851041:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521535.851089:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48f136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521535.851122:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162048 00000100:00100000:1.0:1788521535.851129:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162048 00000100:00100000:1.0:1788521535.851172:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521535.851180:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368162048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521535.851192:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521535.851205:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a7575a400/0x53df1cebae017618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017611 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.851225:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a7575a400/0x53df1cebae017618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017611 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.851235:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a7575a400/0x53df1cebae017618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017611 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.851244:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a7575a400, rc 0) 00000100:00100000:1.0:1788521535.851277:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368162048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521535.851283:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788521535.851326:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368162048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521535.851340:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017618 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.851350:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017618 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521535.851394:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368162176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788521535.851428:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521535.851440:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48f136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521535.851451:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162176 00000100:00100000:1.0:1788521535.851455:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162176 00000100:00100000:1.0:1788521535.851475:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521535.851481:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368162176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788521535.851494:0:14426:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788521535.851510:0:14426:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788521535.851513:0:14426:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788521535.851580:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368162176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521535.851588:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788521535.851621:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368162176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788521535.851669:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788521535.851675:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017618 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521535.851683:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a7575ac00/0x53df1cebae017611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017618 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521536.105406:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368162304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521536.105482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521536.105644:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162304 00000100:00100000:1.0:1788521536.105652:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162304 00000100:00100000:1.0:1788521536.105715:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521536.105724:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368162304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788521536.105758:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788521536.105847:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521536.114971:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368162304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9238us (9480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521536.114994:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521536.115328:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788521536.115358:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368162304:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788521536.619421:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521537.009142:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788521537.644557:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521538.665437:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521539.698957:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788521539.698964:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788521539.698969:0:38:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788521539.698981:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0a60446800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1788521539.699014:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0a7f31e680 x1875400368162688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788521539.699146:0:3299:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368162688:0@lo:8:kworker.0 00000100:00100000:1.0:1788521539.699216:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368162944:0@lo:400:kworker.0 00010000:00010000:3.0:1788521539.699269:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521539.699640:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368162432:0@lo:400:kworker.0 00000100:00100000:0.0:1788521539.700895:0:3299:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521539.700906:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521539.700985:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162688 00000100:00100000:0.0:1788521539.700994:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162688 00000100:00100000:0.0:1788521539.701029:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521539.701037:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1875400368162688:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788521539.701069:0:15114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1788521539.701235:0:15114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x53df1cebae01761f 00002000:00100000:0.0:1788521539.701250:0:15114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c0a7ab86000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788521539.701255:0:15114:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788521539.701258:0:15114:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788521539.701418:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368162560:0@lo:400:kworker.0 00000100:00100000:1.0:1788521539.701453:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521539.701480:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521539.701487:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368162816:0@lo:400:kworker.0 00000100:00100000:1.0:1788521539.701516:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521539.701696:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162944 00000100:00100000:1.0:1788521539.701702:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162944 00000100:00100000:1.0:1788521539.701752:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162816 00000100:00100000:1.0:1788521539.701757:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162816 00000100:00100000:1.0:1788521539.701809:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00002000:00080000:0.0:1788521539.701814:0:15114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788521539.701819:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368162944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521539.701872:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368162944:12345-0@lo:400:kworker.0 Request processed in 56us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521539.701879:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788521539.702125:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521539.702132:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368162816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521539.702239:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368162816:12345-0@lo:400:kworker.0 Request processed in 107us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521539.702245:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788521539.702262:0:15117:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788521539.702269:0:15117:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1788521539.702305:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31ca80 x1875400368162944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521539.702318:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368162944:0@lo:400:kworker.0 00010000:00080000:1.0:1788521539.702343:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31ce00 x1875400368162816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788521539.702351:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368162816:0@lo:400:kworker.0 00000100:00100000:1.0:1788521539.702850:0:15116:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788521539.702860:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162560 00000100:00100000:1.0:1788521539.702865:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162560 00000100:00100000:1.0:1788521539.702905:0:15116:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00080000:0.0:1788521539.702935:0:15114:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab85000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521539.702992:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1875400368162688:12345-0@lo:8:kworker.0 Request processed in 1954us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521539.703001:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521539.703020:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788521539.703028:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368162560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521539.703078:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368162560:12345-0@lo:400:kworker.0 Request processed in 52us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521539.703085:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788521539.704445:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368162560:0@lo:400:kworker.0 00010000:00080000:0.0:1788521539.704612:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31e680 x1875400368162688/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788521564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788521539.704627:0:3299:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788521539.704635:0:3299:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788521539.704641:0:3299:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788521539.704652:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8c0a60446800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788521539.704756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521539.704824:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368163072:0@lo:400:kworker.0 00000100:00100000:3.0:1788521539.704866:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788521539.705259:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788521539.705267:0:3299:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1875400368162688:0@lo:8:kworker.0 00000004:00080000:2.0:1788521539.705272:0:14455:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788521539.705682:0:14455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460783908023ns, next at 0ns, rc = 0 00000100:00080000:3.0:1788521539.705895:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788521539.705901:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521539.705914:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368162432 00000100:00100000:3.0:1788521539.705921:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368162432 00000100:00100000:3.0:1788521539.705960:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521539.705969:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368162432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521539.706031:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368162432:12345-0@lo:400:kworker.0 Request processed in 63us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521539.706037:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788521539.706066:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163072 00000100:00100000:3.0:1788521539.706069:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163072 00000100:00100000:3.0:1788521539.706097:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521539.706102:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368163072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521539.706128:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875400368163072:12345-0@lo:400:kworker.0 Request processed in 26us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521539.706133:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788521539.706373:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368162432:0@lo:400:kworker.0 00010000:00080000:3.0:1788521539.706389:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a7f31fb80 x1875400368163072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521539.706401:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1875400368163072:0@lo:400:kworker.0 00000100:00080000:3.0:1788521539.706421:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788521539.708851:0:14456:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788521539.708879:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1875400368163328:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788521539.708950:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521539.708977:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a609c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521539.709281:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368163200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788521539.709324:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521539.709363:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163328 00000100:00100000:1.0:1788521539.709370:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163328 00000100:00100000:1.0:1788521539.709424:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521539.709432:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14456:x1875400368163328:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788521539.712191:0:15116:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788521539.712202:0:15116:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788521539.712207:0:15116:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:3.0:1788521539.712981:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521539.713855:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163200 00000100:00100000:2.0:1788521539.713865:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163200 00000100:00100000:2.0:1788521539.713919:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788521539.713930:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368163200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788521539.713968:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521539.714058:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1875400368163200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521539.714065:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788521539.714116:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0a75b0ea00 x1875400368163200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788521555 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788521539.714138:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368163200:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1788521539.730388:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.730406:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730426:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.730431:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.730437:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730455:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730466:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730473:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730495:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.730510:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.730515:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730522:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.730526:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730535:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730556:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730563:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.730580:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.730582:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.730584:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.741561:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.741577:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741594:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.741599:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.741606:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741620:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741629:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741638:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741674:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.741691:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.741697:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741705:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.741710:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741719:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741735:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741743:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae01762d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.741760:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.741762:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.741790:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.746231:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.746244:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746260:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.746271:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.746279:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746294:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746304:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746312:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746333:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.746349:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.746355:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746363:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.746367:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746377:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746392:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746409:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac687ce3/0x53df1cebae017634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746426:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.746428:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.746429:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.746867:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.746874:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746882:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.746885:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.746889:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746898:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746906:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746914:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746928:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.746939:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.746949:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746956:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.746959:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746967:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746978:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746986:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000329ad51f/0x53df1cebae01763b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.746998:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.747000:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.747002:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.747385:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.747391:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747399:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.747401:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.747405:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747425:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747433:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747440:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747454:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.747463:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.747467:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747474:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575bc00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.747477:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747483:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747492:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747499:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061eaf99c/0x53df1cebae017642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.747519:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.747520:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.747522:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.751352:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.751364:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.751382:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.751386:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.751393:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.751408:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.751418:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.751426:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.751452:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.751495:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.751504:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.751514:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575be00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.751519:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.751539:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.751560:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.751568:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063063df1/0x53df1cebae017649 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.751590:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.751593:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.751595:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.751963:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.751970:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.751990:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.751993:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.751998:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752007:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752016:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752023:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752045:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.752066:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.752073:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752082:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575ba00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.752086:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752094:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752106:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752124:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bbd98bb/0x53df1cebae017650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752140:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.752143:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.752146:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.752457:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.752463:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752471:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.752474:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.752479:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752487:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752507:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752515:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.752540:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.752599:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.752606:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752615:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575a000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.752619:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752627:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752640:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752648:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad32d03c/0x53df1cebae017657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.752666:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.752668:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.752671:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.752989:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.752995:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753004:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.753007:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.753011:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753021:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753028:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753035:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753068:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.753104:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.753110:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753119:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575aa00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.753123:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753132:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753145:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753152:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a16e05d/0x53df1cebae01765e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753169:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.753172:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.753174:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.753448:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.753454:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753463:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.753466:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.753470:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753479:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753486:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753494:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753514:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.753532:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.753539:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753548:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166fa00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.753552:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753572:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753584:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753592:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c422a558/0x53df1cebae017665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.753610:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.753613:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.753616:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.753925:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.753931:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753939:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.753947:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.753952:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753960:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753968:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753976:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.753995:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.754072:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.754078:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.754086:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166e600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.754090:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.754098:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.754109:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.754129:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f54a94/0x53df1cebae01766c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.754144:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.754146:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.754148:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.761076:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.761090:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761107:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.761112:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.761119:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761133:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761144:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761159:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761175:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521539.761876:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.761949:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761962:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.761966:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.761970:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761981:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761989:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.761997:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762017:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788521539.762033:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521539.762039:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762052:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.762057:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762066:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762081:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762088:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012d8a06b/0x53df1cebae017673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762107:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.762110:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762116:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.762119:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762127:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762136:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762149:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b29d1db/0x53df1cebae01767a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762163:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.762165:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.762166:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521539.762324:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.762843:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.762850:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762860:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.762864:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.762869:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.762880:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763234:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763241:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763260:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.763291:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.763298:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.763307:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166ec00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.763311:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.763321:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.763335:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.763341:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083b4c72b/0x53df1cebae017681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.763359:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.763362:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.763364:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.763871:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.763893:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763904:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.763908:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.763912:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763922:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763930:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763938:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.763958:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788521539.764029:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788521539.764035:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.764043:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521539.764047:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.764055:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.764069:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.764076:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001723eead/0x53df1cebae017688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521539.764094:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.764097:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521539.764099:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.766406:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.766419:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766435:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.766438:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.766444:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766457:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766477:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766484:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766505:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.766518:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.766523:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766531:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166e400 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.766535:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766543:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766559:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766568:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e47308de/0x53df1cebae01768f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.766587:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.766595:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.766597:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.767175:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.767182:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.767192:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.767195:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.767200:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.767210:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.767218:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.767225:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.767242:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521539.767389:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521539.767396:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521539.767404:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166e200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521539.767407:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521539.767416:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521539.767431:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521539.767439:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061598b9d/0x53df1cebae017696 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521539.767456:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521539.767457:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521539.767459:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.768509:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.768518:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.768530:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.768534:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.768539:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.768557:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.768566:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.768574:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.768595:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521539.769058:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.769205:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769215:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.769218:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.769222:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769232:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769240:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769259:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769275:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788521539.769347:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521539.769352:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769360:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.769365:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769374:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769387:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769394:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd5afaa/0x53df1cebae01769d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769411:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.769415:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769431:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166ea00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.769435:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769442:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769451:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769458:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aff16f0c/0x53df1cebae0176a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769469:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.769470:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.769472:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.769908:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.769914:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769924:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.769927:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.769931:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769940:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769954:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769961:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.769976:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788521539.770407:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521539.770415:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.770423:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a4166f000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521539.770427:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.770436:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.770454:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.770461:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e5d74ff/0x53df1cebae0176ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.770479:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521539.770481:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521539.770489:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.772957:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.772973:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.772990:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.772995:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.773001:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773017:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773029:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773037:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773080:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.773097:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.773103:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773111:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a7575b800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.773116:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773126:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773142:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773149:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b187975c/0x53df1cebae0176b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773170:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.773172:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.773174:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.773852:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.773860:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.773870:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.773878:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521539.774361:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.774978:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775005:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775022:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775030:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775050:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.775063:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.775068:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775076:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325c00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.775082:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775091:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775105:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775125:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef8bcf7/0x53df1cebae0176b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.775144:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.775145:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.775147:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.777337:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.777348:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777362:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.777366:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.777373:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777387:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777397:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777404:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777421:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.777431:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.777442:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777449:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f324800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.777453:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777463:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777477:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777485:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005742709e/0x53df1cebae0176c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.777503:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.777505:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.777507:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.778694:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.778703:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.778715:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.778719:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.778725:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.778751:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.778760:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.778803:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.778821:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788521539.779283:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.779407:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.779417:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.779420:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.779425:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.779436:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.779444:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.779464:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.779483:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788521539.779982:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.779989:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.779998:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.780001:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.780006:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780015:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780024:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780031:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780049:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788521539.780063:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788521539.780069:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780083:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325e00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.780087:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780097:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780112:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780120:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051355ac2/0x53df1cebae0176c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780141:0:14420:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521539.780145:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780152:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325a00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.780156:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780164:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780174:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.780192:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c572ff45/0x53df1cebae0176ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.780244:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521539.780251:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.780258:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f324e00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521539.780261:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.780269:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.780281:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.780359:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e343c5ec/0x53df1cebae0176d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521539.780374:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521539.780375:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521539.780377:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.780414:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.780416:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.780418:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521539.781097:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788521539.781195:0:15116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788521539.781202:0:15116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781212:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=460s v=(0 0) 00010000:00010000:1.0:1788521539.781216:0:15116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521539.781220:0:15116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781231:0:15116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781240:0:15116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781249:0:15116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781265:0:15116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788521539.781273:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788521539.781297:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781304:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521539.781307:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781315:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781325:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781332:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c44d690/0x53df1cebae0176dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521539.781344:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.781346:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521539.781348:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788521539.781533:0:15116:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788521539.781624:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14456:x1875400368163328:12345-0@lo:5:osp-pre-1-0.0 Request processed in 72190us (72671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521539.781633:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788521539.783025:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1875400368163328:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788521539.783044:0:14456:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788521539.783092:0:14456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75b0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1875400368163456:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788521539.783144:0:14456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521539.783190:0:14456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a609c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521539.783210:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163456 00000100:00100000:0.0:1788521539.783216:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163456 00000100:00100000:0.0:1788521539.783259:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788521539.783267:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14456:x1875400368163456:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788521539.783319:0:15117:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:2.0:1788521539.787634:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788521539.792838:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14456:x1875400368163456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9563us (9685us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788521539.792851:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788521539.793434:0:14456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75b0d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14456:1875400368163456:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788521539.793452:0:14456:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788521540.719821:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521541.226426:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788521541.226451:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368163584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788521541.226523:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521541.226591:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163584 00000100:00100000:3.0:1788521541.226599:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163584 00000100:00100000:3.0:1788521541.226653:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788521541.226663:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368163584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521541.226706:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521541.226752:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368163584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521541.226771:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788521541.226814:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521541.226850:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368163584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788521541.737110:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788521541.875495:0:16193:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788521542.766854:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521543.786763:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521544.735490:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521544.735598:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346149376 00000100:00100000:3.0:1788521544.735612:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346149376 00000100:00100000:3.0:1788521544.735668:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:3.0:1788521544.735679:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2344:x1875400346149376:12345-192.168.203.48@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788521544.735719:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 3a30bcea-542d-4612-9aa8-72900b2931cc@192.168.203.48@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788521544.735769:0:14427:0:(genops.c:1385:class_connect()) connect: client 3a30bcea-542d-4612-9aa8-72900b2931cc, cookie 0x53df1cebae0176e3 00000100:00080000:3.0:1788521544.735975:0:14427:0:(import.c:65:import_set_state_nolock()) ffff8c0941318800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521544.736076:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+5:2344:x1875400346149376:12345-192.168.203.48@tcp:250:mount.lustre.0 Request processed in 396us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.736084:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:3.0:1788521544.742762:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521544.742842:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346149504 00000100:00100000:3.0:1788521544.742854:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346149504 00000100:00100000:3.0:1788521544.742924:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1788521544.742936:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+5:13738:x1875400346149504:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521544.742957:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521544.742981:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0176ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440705 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.743032:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0176ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440705 expref: 6 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.743067:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030a00/0x53df1cebae0176ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440705 expref: 6 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.743081:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030a00, rc 0) 00000100:00100000:3.0:1788521544.743154:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+6:13738:x1875400346149504:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 220us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.743161:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:2.0:1788521544.755660:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521544.755740:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346149632 00000100:00100000:2.0:1788521544.755754:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346149632 00000100:00100000:2.0:1788521544.755842:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:2.0:1788521544.755856:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+6:13738:x1875400346149632:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521544.758399:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+6:13738:x1875400346149632:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 2527us (2736us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788521544.758437:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:0.0:1788521544.767918:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521544.768009:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346149760 00000100:00100000:1.0:1788521544.768025:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346149760 00000100:00100000:1.0:1788521544.768095:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:1.0:1788521544.768107:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+6:13738:x1875400346149760:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788521544.768131:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521544.768158:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a6f324400/0x53df1cebae0176f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644070c expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521544.768196:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a6f324400/0x53df1cebae0176f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644070c expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521544.768211:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a6f324400/0x53df1cebae0176f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644070c expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521544.768222:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f324400, rc 0) 00000100:00100000:1.0:1788521544.768295:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+7:13738:x1875400346149760:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 190us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521544.768304:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:1.0:1788521544.777307:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521544.777672:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346149888 00000100:00100000:0.0:1788521544.777689:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346149888 00000100:00100000:0.0:1788521544.777797:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:0.0:1788521544.777812:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+7:13738:x1875400346149888:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788521544.778342:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13738:x1875400346149888:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 532us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.778473:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:2.0:1788521544.784857:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521544.784958:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150016 00000100:00100000:3.0:1788521544.784972:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150016 00000100:00100000:3.0:1788521544.785047:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1788521544.785058:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13738:x1875400346150016:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788521544.785465:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13738:x1875400346150016:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 406us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.785474:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:0.0:1788521544.794612:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521544.794825:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150144 00000100:00100000:2.0:1788521544.794841:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150144 00000100:00100000:2.0:1788521544.794908:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:2.0:1788521544.794919:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13757:x1875400346150144:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521544.795659:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13757:x1875400346150144:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 735us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.795670:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1788521544.809804:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368163712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788521544.809944:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521544.818151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521544.818203:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150272 00000100:00100000:2.0:1788521544.818214:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150272 00000100:00100000:2.0:1788521544.818283:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:2.0:1788521544.818297:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13757:x1875400346150272:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788521544.818671:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13757:x1875400346150272:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 376us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.818681:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:0.0:1788521544.820946:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368164096:0@lo:400:kworker.0 00000100:00100000:0.0:1788521544.821051:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521544.821999:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368163840:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822066:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521544.822141:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368164352:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521544.822210:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521544.822217:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822240:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521544.822271:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368163968:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822310:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163840 00000100:00100000:3.0:1788521544.822320:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163840 00000100:00100000:3.0:1788521544.822393:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788521544.822403:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368163840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822468:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368163840:12345-0@lo:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.822474:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788521544.822515:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164352 00000100:00100000:3.0:1788521544.822519:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164352 00000100:00100000:3.0:1788521544.822558:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164224 00000100:00100000:3.0:1788521544.822560:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164224 00000100:00100000:3.0:1788521544.822575:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521544.822581:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368164352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822615:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368164352:12345-0@lo:400:kworker.0 Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.822622:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788521544.822633:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788521544.822639:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368164224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822664:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875400368164224:12345-0@lo:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.822670:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788521544.822690:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788521544.822727:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0941356300 x1875400368164224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521544.822755:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875400368164224:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.822766:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368163840:0@lo:400:kworker.0 00010000:00080000:3.0:1788521544.822810:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0941355c00 x1875400368164352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521544.822832:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368164352:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.823906:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521544.824055:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521544.824437:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521544.824569:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368164480:0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.824610:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521544.824644:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163712 00000100:00100000:3.0:1788521544.824653:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163712 00000100:00100000:3.0:1788521544.824708:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521544.824717:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368163712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788521544.824792:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521544.824849:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1875400368163712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.824857:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788521544.824884:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521544.824931:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a7f31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368163712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788521544.824960:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164480 00000100:00100000:3.0:1788521544.824964:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164480 00000100:00100000:3.0:1788521544.824995:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788521544.825001:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368164480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788521544.825038:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368164480:12345-0@lo:400:kworker.0 Request processed in 37us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.825044:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788521544.825061:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788521544.825071:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150400 00000100:00100000:3.0:1788521544.825075:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150400 00000100:00100000:3.0:1788521544.825111:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:3.0:1788521544.825118:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+8:13738:x1875400346150400:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521544.825145:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521544.825168:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0176f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440736 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.825200:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0176f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440736 expref: 9 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.825213:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40031c00/0x53df1cebae0176f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440736 expref: 9 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.825223:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031c00, rc 0) 00000100:00100000:3.0:1788521544.825269:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+9:13738:x1875400346150400:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 151us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.825275:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00010000:00080000:3.0:1788521544.825503:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c0941354000 x1875400368164480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788521560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788521544.825515:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368164480:0@lo:400:kworker.0 00000100:00100000:2.0:1788521544.825648:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164096 00000100:00100000:2.0:1788521544.825655:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164096 00000100:00100000:0.0:1788521544.825724:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368163968 00000100:00100000:0.0:1788521544.825739:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368163968 00000100:00100000:0.0:1788521544.825793:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521544.825801:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368164096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521544.825857:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1875400368164096:12345-0@lo:400:kworker.0 Request processed in 58us (4807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521544.825864:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788521544.825877:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521544.825884:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368163968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521544.825916:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368163968:12345-0@lo:400:kworker.0 Request processed in 32us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521544.825922:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788521544.825954:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368164096:0@lo:400:kworker.0 00000100:00080000:3.0:1788521544.826021:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788521544.826041:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368163968:0@lo:400:kworker.0 00000100:00100000:2.0:1788521544.848628:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521544.848749:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150528 00000100:00100000:0.0:1788521544.848763:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150528 00000100:00100000:0.0:1788521544.848854:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:0.0:1788521544.848867:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+9:13738:x1875400346150528:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788521544.848903:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788521544.848936:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788521544.848941:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788521544.848944:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788521544.848947:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788521544.851725:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+9:13738:x1875400346150528:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 2833us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521544.851754:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:0.0:1788521544.856815:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521544.856911:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150656 00000100:00100000:3.0:1788521544.856924:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150656 00000100:00100000:3.0:1788521544.857036:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1788521544.857048:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a456b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+9:13738:x1875400346150656:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521544.857070:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521544.857104:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644073d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.857169:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.857183:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 10 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521544.857195:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030400, rc 0) 00000100:00100000:3.0:1788521544.857273:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a456b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13738:x1875400346150656:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 228us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.857281:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1788521544.872637:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521544.872818:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150784 00000100:00100000:0.0:1788521544.872844:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150784 00000100:00100000:0.0:1788521544.872911:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:0.0:1788521544.872922:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13738:x1875400346150784:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788521544.873393:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13738:x1875400346150784:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 468us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521544.873404:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:1.0:1788521544.885579:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521544.885630:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346150912 00000100:00100000:1.0:1788521544.885660:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346150912 00000100:00100000:1.0:1788521544.885725:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:1.0:1788521544.885748:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13738:x1875400346150912:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788521544.886167:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13738:x1875400346150912:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 419us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521544.886176:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:1.0:1788521544.899864:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521544.899912:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151040 00000100:00100000:1.0:1788521544.899926:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151040 00000100:00100000:1.0:1788521544.899994:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:1.0:1788521544.900005:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13761:x1875400346151040:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788521544.900594:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13761:x1875400346151040:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 588us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521544.900604:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:2.0:1788521544.904954:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521544.907612:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151168 00000100:00100000:3.0:1788521544.907633:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151168 00000100:00100000:3.0:1788521544.907792:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1788521544.907806:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13761:x1875400346151168:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521544.908205:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13761:x1875400346151168:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 400us (3265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521544.908215:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:0.0:1788521544.928926:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521544.929917:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151296 00000100:00100000:1.0:1788521544.929934:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151296 00000100:00100000:1.0:1788521544.929994:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1788521544.930004:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2344:x1875400346151296:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788521544.930044:0:14432:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a9d6363a-faa2-4e4e-95b5-3945c860eba1@192.168.203.48@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1788521544.930110:0:14432:0:(genops.c:1385:class_connect()) connect: client a9d6363a-faa2-4e4e-95b5-3945c860eba1, cookie 0x53df1cebae017706 00000004:00100000:1.0:1788521544.930151:0:14432:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788521544.930159:0:14432:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788521544.934612:0:7652:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788521544.934652:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:1.0:1788521544.967403:0:14432:0:(import.c:65:import_set_state_nolock()) ffff8c0942f37000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521544.967530:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2344:x1875400346151296:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 37523us (38615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521544.967563:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1788521544.977583:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521544.977631:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521544.977762:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151552 00000100:00100000:2.0:1788521544.977816:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151552 00000100:00100000:2.0:1788521544.977897:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151424 00000100:00100000:2.0:1788521544.977900:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151424 00000100:00100000:2.0:1788521544.977919:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1788521544.977930:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:13738:x1875400346151552:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788521544.977994:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788521544.978123:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:13738:x1875400346151552:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 192us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.978131:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1788521544.978151:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1788521544.978157:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:0:x1875400346151424:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788521544.978169:0:14431:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788521544.978191:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:0:x1875400346151424:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.978197:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00080000:0.0:1788521544.978278:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521544.987450:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521544.987769:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151680 00000100:00100000:2.0:1788521544.987805:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151680 00000100:00100000:2.0:1788521544.987887:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1788521544.987899:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13738:x1875400346151680:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788521544.988021:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13738:x1875400346151680:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 123us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.988030:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1788521544.991488:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521544.991629:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151808 00000100:00100000:1.0:1788521544.991642:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151808 00000100:00100000:1.0:1788521544.991704:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:1.0:1788521544.991714:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875400346151808:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788521544.991769:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a9d6363a-faa2-4e4e-95b5-3945c860eba1@192.168.203.48@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1788521544.991877:0:15116:0:(genops.c:1385:class_connect()) connect: client a9d6363a-faa2-4e4e-95b5-3945c860eba1, cookie 0x53df1cebae01770d 00002000:00100000:1.0:1788521544.991902:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a9d6363a-faa2-4e4e-95b5-3945c860eba1/ffff8c0942f37800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788521544.991935:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788521544.992380:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788521544.992428:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8c0942f31000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788521544.992524:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2344:x1875400346151808:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 809us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521544.992533:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:1.0:1788521544.995291:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521544.995405:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346151936 00000100:00100000:2.0:1788521544.995418:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346151936 00000100:00100000:2.0:1788521544.995500:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1788521544.995511:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2344:x1875400346151936:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788521544.995559:0:16085:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a9d6363a-faa2-4e4e-95b5-3945c860eba1@192.168.203.48@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1788521544.995602:0:16085:0:(genops.c:1385:class_connect()) connect: client a9d6363a-faa2-4e4e-95b5-3945c860eba1, cookie 0x53df1cebae017714 00002000:00100000:2.0:1788521544.995618:0:16085:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a9d6363a-faa2-4e4e-95b5-3945c860eba1/ffff8c09422eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521544.995633:0:16085:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788521544.996297:0:16085:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788521544.996334:0:16085:0:(import.c:65:import_set_state_nolock()) ffff8c09422e9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521544.996421:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2344:x1875400346151936:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 911us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521544.996430:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1788521544.998407:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521544.998523:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152064 00000100:00100000:3.0:1788521544.998536:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152064 00000100:00100000:3.0:1788521544.998609:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521544.998621:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13738:x1875400346152064:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788521545.001088:0:14434:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2373us 00000004:00200000:3.0:1788521545.014333:0:14434:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788521545.014534:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13738:x1875400346152064:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 15905us (16130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521545.014563:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1788521545.165202:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521545.165308:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152192 00000100:00100000:1.0:1788521545.165322:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152192 00000100:00100000:1.0:1788521545.165399:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:1.0:1788521545.165411:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13782:x1875400346152192:12345-192.168.203.48@tcp:101:mkdir.0 00010000:00010000:1.0:1788521545.165437:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521545.165472:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01771b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440767 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521545.165702:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae017722 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521545.165721:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae017722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521545.165749:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae017722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521545.166017:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521545.166023:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521545.166074:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae017722 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521545.166108:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01771b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440767 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521545.166131:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae017722 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440767 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521545.166141:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521545.166143:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521545.166148:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f325200, rc 0) 00000100:00100000:1.0:1788521545.166279:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:13782:x1875400346152192:12345-192.168.203.48@tcp:101:mkdir.0 Request processed in 870us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521545.166288:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000001:00100000:2.0:1788521545.395687:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a9d6363a-faa2-4e4e-95b5-3945c860eba1 00010000:00010000:0.0:1788521545.835251:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521546.345273:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368164608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521546.345380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521546.346485:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164608 00000100:00100000:3.0:1788521546.346500:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164608 00000100:00100000:3.0:1788521546.346597:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521546.346610:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368164608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788521546.346641:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521546.346750:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368164608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521546.346757:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788521546.347458:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521546.347528:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368164608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788521546.859811:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788521547.243497:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788521547.294076:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.294363:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152320 00000100:00100000:0.0:1788521547.294376:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152320 00000100:00100000:0.0:1788521547.294889:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1788521547.294904:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:13834:x1875400346152320:12345-192.168.203.48@tcp:41:lfs.0 00000004:00000024:0.0:1788521547.294969:0:14433:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521547.295098:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:13834:x1875400346152320:12345-192.168.203.48@tcp:41:lfs.0 Request processed in 197us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.295106:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00080000:3.0:1788521547.295976:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521547.301036:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521547.301394:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152448 00000100:00100000:3.0:1788521547.301410:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152448 00000100:00100000:3.0:1788521547.301529:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1788521547.301543:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:13834:x1875400346152448:12345-192.168.203.48@tcp:13:lfs.0 00002000:00000024:3.0:1788521547.301603:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788521547.301744:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:13834:x1875400346152448:12345-192.168.203.48@tcp:13:lfs.0 Request processed in 203us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521547.301752:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00080000:0.0:1788521547.302408:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521547.306567:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521547.306937:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152576 00000100:00100000:3.0:1788521547.306952:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152576 00000100:00100000:3.0:1788521547.307046:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521547.307060:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13834:x1875400346152576:12345-192.168.203.48@tcp:13:lfs.0 00002000:00000024:3.0:1788521547.307115:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788521547.307335:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521547.307518:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941357480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:13834:x1875400346152576:12345-192.168.203.48@tcp:13:lfs.0 Request processed in 459us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521547.307543:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1788521547.458287:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.458410:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152704 00000100:00100000:0.0:1788521547.458423:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152704 00000100:00100000:0.0:1788521547.458499:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:0.0:1788521547.458511:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+10:13864:x1875400346152704:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788521547.458534:0:14424:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521547.458558:0:14424:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae017729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644076e expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.458657:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae017729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644076e expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.458671:0:14424:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6ec00/0x53df1cebae017729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644076e expref: 11 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.458681:0:14424:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6ec00, rc 0) 00000100:00100000:0.0:1788521547.458855:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13864:x1875400346152704:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 346us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.458871:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:1.0:1788521547.466152:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521547.466291:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152832 00000100:00100000:3.0:1788521547.466305:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152832 00000100:00100000:3.0:1788521547.466377:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:3.0:1788521547.466390:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13864:x1875400346152832:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788521547.466984:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13864:x1875400346152832:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 593us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521547.466995:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:2.0:1788521547.471233:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521547.471347:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346152960 00000100:00100000:1.0:1788521547.471362:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346152960 00000100:00100000:1.0:1788521547.471435:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1788521547.471448:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13864:x1875400346152960:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788521547.472268:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13864:x1875400346152960:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 816us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.472280:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1788521547.485024:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.493574:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153088 00000100:00100000:0.0:1788521547.493606:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153088 00000100:00100000:0.0:1788521547.493730:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:0.0:1788521547.493747:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13873:x1875400346153088:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521547.495407:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13873:x1875400346153088:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 1655us (10387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.495436:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:1.0:1788521547.527460:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521547.527759:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153216 00000100:00100000:3.0:1788521547.527817:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153216 00000100:00100000:3.0:1788521547.527904:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:3.0:1788521547.527917:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13873:x1875400346153216:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788521547.528310:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13873:x1875400346153216:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 394us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521547.528319:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:3.0:1788521547.543378:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521547.543844:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153344 00000100:00100000:2.0:1788521547.543859:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153344 00000100:00100000:2.0:1788521547.543936:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:2.0:1788521547.543948:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13864:x1875400346153344:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788521547.543970:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521547.543995:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a439a0400/0x53df1cebae017730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440798 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521547.544035:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a439a0400/0x53df1cebae017730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440798 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521547.544047:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a439a0400/0x53df1cebae017730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440798 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521547.544075:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0400, rc 0) 00000100:00100000:2.0:1788521547.544157:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13864:x1875400346153344:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 210us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521547.544165:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:1.0:1788521547.549502:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.549630:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153472 00000100:00100000:0.0:1788521547.549643:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153472 00000100:00100000:0.0:1788521547.549725:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:0.0:1788521547.549738:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13864:x1875400346153472:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788521547.549813:0:14424:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788521547.549850:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788521547.549855:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788521547.549858:0:14424:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788521547.549860:0:14424:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788521547.556038:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13864:x1875400346153472:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 6287us (6536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.556058:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:1.0:1788521547.563417:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521547.563503:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153600 00000100:00100000:3.0:1788521547.563521:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153600 00000100:00100000:3.0:1788521547.563637:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:3.0:1788521547.563661:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13864:x1875400346153600:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788521547.563685:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521547.563709:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a644079f expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521547.563756:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521547.564505:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521547.564520:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40031000, rc 0) 00000100:00100000:0.0:1788521547.565223:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13864:x1875400346153600:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 1570us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.565243:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:2.0:1788521547.567567:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.569158:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153728 00000100:00100000:0.0:1788521547.569177:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153728 00000100:00100000:0.0:1788521547.569391:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:0.0:1788521547.569404:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13864:x1875400346153728:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788521547.570211:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75578050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13864:x1875400346153728:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 804us (2653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.570223:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:1.0:1788521547.573659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.573818:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153856 00000100:00100000:0.0:1788521547.573949:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153856 00000100:00100000:0.0:1788521547.574325:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:0.0:1788521547.574356:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13864:x1875400346153856:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788521547.575421:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13864:x1875400346153856:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 1058us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.575437:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:2.0:1788521547.579936:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.580014:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346153984 00000100:00100000:0.0:1788521547.580027:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346153984 00000100:00100000:0.0:1788521547.580094:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:0.0:1788521547.580106:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13880:x1875400346153984:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521547.580752:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7557ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13880:x1875400346153984:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 644us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.580763:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:1.0:1788521547.589585:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.589956:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154112 00000100:00100000:0.0:1788521547.589970:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154112 00000100:00100000:0.0:1788521547.590043:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:0.0:1788521547.590055:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13880:x1875400346154112:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788521547.592242:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75579c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13880:x1875400346154112:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 2168us (2652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.592260:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:1.0:1788521547.604550:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521547.604604:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521547.604651:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521547.604693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521547.604751:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154752 00000100:00100000:1.0:1788521547.604764:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154752 00000100:00100000:1.0:1788521547.604871:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154880 00000100:00100000:1.0:1788521547.604875:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154880 00000100:00100000:1.0:1788521547.604899:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1788521547.604912:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2347:x1875400346154752:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521547.605011:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2347:x1875400346154752:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 101us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521547.605020:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1788521547.605040:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1788521547.605047:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2347:x1875400346154880:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521547.605097:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2347:x1875400346154880:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 51us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521547.605103:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1788521547.605343:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154240 00000100:00100000:3.0:1788521547.605360:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154240 00000100:00100000:3.0:1788521547.605390:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154624 00000100:00100000:3.0:1788521547.605394:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154624 00000100:00100000:3.0:1788521547.605415:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1788521547.605422:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2347:x1875400346154624:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521547.605462:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2347:x1875400346154624:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 41us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521547.605469:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1788521547.605483:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1788521547.605488:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2344:x1875400346154240:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788521547.605517:0:14433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7d3d61bb-199f-444a-897c-ee821b4c8e79@192.168.203.48@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:3.0:1788521547.605556:0:14433:0:(genops.c:1385:class_connect()) connect: client 7d3d61bb-199f-444a-897c-ee821b4c8e79, cookie 0x53df1cebae01773e 00000004:00100000:3.0:1788521547.605601:0:14433:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788521547.605807:0:14433:0:(import.c:65:import_set_state_nolock()) ffff8c094131b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788521547.605844:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2344:x1875400346154240:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 354us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521547.605850:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1788521547.624733:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521547.624860:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521547.624975:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154496 00000100:00100000:0.0:1788521547.624981:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346154368 00000100:00100000:3.0:1788521547.624990:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154496 00000100:00100000:0.0:1788521547.624990:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346154368 00000100:00080000:1.0:1788521547.625207:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788521547.627457:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1788521547.627485:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+7:0:x1875400346154368:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521547.627536:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521547.627825:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+7:0:x1875400346154368:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 351us (2963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.627858:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1788521547.627886:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1788521547.627894:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13864:x1875400346154496:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788521547.627908:0:14432:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788521547.627934:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13864:x1875400346154496:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 41us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.627941:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1788521547.630211:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.631087:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155008 00000100:00100000:0.0:1788521547.631102:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155008 00000100:00100000:0.0:1788521547.631168:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1788521547.631180:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13864:x1875400346155008:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788521547.631424:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13864:x1875400346155008:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 246us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.631433:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1788521547.635514:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521547.636837:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155392 00000100:00100000:2.0:1788521547.636855:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155392 00000100:00100000:2.0:1788521547.636921:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1788521547.636933:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13864:x1875400346155392:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788521547.637028:0:14435:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788521547.637139:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13864:x1875400346155392:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 208us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521547.637148:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1788521547.641745:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521547.641834:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521547.641902:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155136 00000100:00100000:2.0:1788521547.641915:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155136 00000100:00100000:2.0:1788521547.641963:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155264 00000100:00100000:2.0:1788521547.641965:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155264 00000100:00100000:2.0:1788521547.641984:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1788521547.641993:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2344:x1875400346155136:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788521547.642036:0:15117:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7d3d61bb-199f-444a-897c-ee821b4c8e79@192.168.203.48@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1788521547.642079:0:15117:0:(genops.c:1385:class_connect()) connect: client 7d3d61bb-199f-444a-897c-ee821b4c8e79, cookie 0x53df1cebae017745 00002000:00100000:2.0:1788521547.642111:0:15117:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d3d61bb-199f-444a-897c-ee821b4c8e79/ffff8c09422e8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788521547.642123:0:15117:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788521547.642505:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1788521547.642512:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2344:x1875400346155264:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788521547.642535:0:15116:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7d3d61bb-199f-444a-897c-ee821b4c8e79@192.168.203.48@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788521547.642558:0:15116:0:(genops.c:1385:class_connect()) connect: client 7d3d61bb-199f-444a-897c-ee821b4c8e79, cookie 0x53df1cebae01774c 00002000:00100000:0.0:1788521547.642564:0:15116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d3d61bb-199f-444a-897c-ee821b4c8e79/ffff8c0a7ab87800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788521547.642572:0:15116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788521547.642696:0:15116:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788521547.642747:0:15116:0:(import.c:65:import_set_state_nolock()) ffff8c0a7ab82000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788521547.642881:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2344:x1875400346155264:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 366us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.642889:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00002000:00080000:2.0:1788521547.644193:0:15117:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788521547.645374:0:15117:0:(import.c:65:import_set_state_nolock()) ffff8c09422ef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788521547.645500:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2344:x1875400346155136:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 3502us (3765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521547.645513:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1788521547.847447:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521547.848025:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155520 00000100:00100000:0.0:1788521547.848042:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155520 00000100:00100000:0.0:1788521547.848141:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521547.848155:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:13901:x1875400346155520:12345-192.168.203.48@tcp:101:mkdir.0 00010000:00010000:0.0:1788521547.848189:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521547.848223:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407c9 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.848318:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.848344:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.849041:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521547.849094:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788521547.849098:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521547.849126:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.849165:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 8 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.849189:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 7 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521547.849421:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:0.0:1788521547.849425:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521547.849431:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6fe00, rc 0) 00000100:00100000:0.0:1788521547.849620:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+7:13901:x1875400346155520:12345-192.168.203.48@tcp:101:mkdir.0 Request processed in 1465us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521547.849631:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00010000:00010000:1.0:1788521547.884613:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521548.905594:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788521549.929278:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788521549.929301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368164736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521549.929371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521549.929482:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164736 00000100:00100000:0.0:1788521549.929491:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164736 00000100:00100000:0.0:1788521549.929560:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521549.929571:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368164736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788521549.929607:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521549.929660:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1875400368164736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521549.929668:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788521549.929729:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788521549.929755:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1875400368164736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788521549.930436:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788521549.931299:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788521549.931324:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368164992:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931384:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521549.931429:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521549.931435:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368165120:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931460:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521549.931487:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164992 00000100:00100000:1.0:1788521549.931494:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164992 00000100:00100000:1.0:1788521549.931545:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521549.931553:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368164992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931604:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368164992:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521549.931611:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521549.931635:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368165120 00000100:00100000:1.0:1788521549.931640:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368165120 00000100:00100000:1.0:1788521549.931667:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521549.931673:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368165120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931716:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1875400368165120:12345-0@lo:400:kworker.0 Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521549.931723:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788521549.931759:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368165248:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931816:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521549.931833:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788521549.931838:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368164864:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931866:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521549.931884:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368165376:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.931904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788521549.931923:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521549.931930:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368165248 00000100:00100000:1.0:1788521549.931933:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368165248 00000100:00100000:1.0:1788521549.931958:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368165376 00000100:00100000:1.0:1788521549.931960:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368165376 00000100:00100000:1.0:1788521549.931978:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788521549.931984:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368165248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.932017:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368165248:12345-0@lo:400:kworker.0 Request processed in 32us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521549.932024:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788521549.933633:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1875400368165120:0@lo:400:kworker.0 00000100:00100000:3.0:1788521549.934180:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368164992:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.934342:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788521549.934355:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368165376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.934430:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1875400368165376:12345-0@lo:400:kworker.0 Request processed in 79us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521549.934437:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788521549.934461:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521549.934486:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1875400368165376:0@lo:400:kworker.0 00000100:00100000:1.0:1788521549.934499:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368165248:0@lo:400:kworker.0 00000100:00100000:0.0:1788521549.934634:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368164864 00000100:00100000:0.0:1788521549.934643:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368164864 00000100:00100000:0.0:1788521549.934689:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788521549.934705:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3302:x1875400368164864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521549.934762:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3302:x1875400368164864:12345-0@lo:400:kworker.0 Request processed in 66us (2895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521549.934768:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788521549.936496:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3302:1875400368164864:0@lo:400:kworker.0 00000001:00100000:2.0:1788521549.996966:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d3d61bb-199f-444a-897c-ee821b4c8e79 00000001:00100000:2.0:1788521549.999332:0:7652:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a9d6363a-faa2-4e4e-95b5-3945c860eba1 00000001:00100000:2.0:1788521550.556997:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d3d61bb-199f-444a-897c-ee821b4c8e79 00000001:00100000:1.0:1788521550.558412:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a9d6363a-faa2-4e4e-95b5-3945c860eba1 00000001:00100000:1.0:1788521550.558429:0:5854:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d3d61bb-199f-444a-897c-ee821b4c8e79 00010000:00010000:3.0:1788521550.956035:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788521550.999183:0:16403:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788521551.466394:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368165504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788521551.466471:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521551.466762:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368165504 00000100:00100000:0.0:1788521551.466770:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368165504 00000100:00100000:0.0:1788521551.466874:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788521551.466891:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368165504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521551.466942:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521551.467142:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368165504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521551.467155:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788521551.467800:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521551.472884:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6ddc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368165504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521551.977640:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788521553.000910:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521553.005207:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521553.005355:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155648 00000100:00100000:2.0:1788521553.005369:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155648 00000100:00100000:2.0:1788521553.005436:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:2.0:1788521553.005449:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:2347:x1875400346155648:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521553.005535:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+13:2347:x1875400346155648:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521553.005544:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:3.0:1788521553.007469:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521553.007544:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521553.007572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521553.007590:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521553.007609:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521553.007632:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521553.007850:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155904 00000100:00100000:3.0:1788521553.007861:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155904 00000100:00100000:3.0:1788521553.007922:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156416 00000100:00100000:3.0:1788521553.007926:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156416 00000100:00100000:3.0:1788521553.007943:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156032 00000100:00100000:3.0:1788521553.007946:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156032 00000100:00100000:3.0:1788521553.007958:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156288 00000100:00100000:3.0:1788521553.007960:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156288 00000100:00100000:3.0:1788521553.007980:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521553.007991:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2347:x1875400346155904:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521553.008074:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2347:x1875400346155904:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 84us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521553.008082:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521553.008102:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1788521553.008108:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2347:x1875400346156416:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521553.008133:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2347:x1875400346156416:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521553.008139:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1788521553.008163:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521553.008169:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2347:x1875400346156032:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521553.008194:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2347:x1875400346156032:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521553.008200:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521553.008213:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1788521553.008219:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2347:x1875400346156288:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521553.008242:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2347:x1875400346156288:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521553.008247:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1788521553.008349:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156160 00000100:00100000:3.0:1788521553.008354:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156160 00000100:00100000:3.0:1788521553.008385:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346155776 00000100:00100000:3.0:1788521553.008389:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346155776 00000100:00100000:3.0:1788521553.008407:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1788521553.008413:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2347:x1875400346156160:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521553.008441:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2347:x1875400346156160:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521553.008449:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1788521553.008460:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1788521553.008466:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2347:x1875400346155776:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521553.008488:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2347:x1875400346155776:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 22us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521553.008494:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00080000:3.0:1788521553.008532:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788521553.008538:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788521553.008541:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788521554.025039:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788521554.946639:0:16550:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe15dd01a0 20000000:00000080:1.0:1788521554.946673:0:16550:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c09422c0400 uarg=0000000000000000 20000000:01000000:1.0:1788521554.946739:0:16550:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788521554.946745:0:16550:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788521554.946749:0:16550:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788521554.947840:0:16551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788521554.948009:0:16550:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788521554.964427:0:16550:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788521554.964683:0:16550:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.964706:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017451 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.964714:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.964722:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.964731:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.964739:0:16550:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.965727:0:16550:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967014:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967037:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 12 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.967055:0:16550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943588a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368165632:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521554.967310:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967319:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 12 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.967330:0:16550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943588e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368165760:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521554.967367:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967375:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.967383:0:16550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c094358aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368165888:0@lo:104: 00000100:00100000:3.0:1788521554.967421:0:16550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521554.967468:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967476:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.967485:0:16550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943588380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368166016:0@lo:104: 00000100:00100000:3.0:1788521554.967505:0:16550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788521554.967540:0:16550:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x53df1cebae017451 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967549:0:16550:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x53df1cebae017451 expref: 18 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.967556:0:16550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943588000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368166144:0@lo:104: 00000100:00100000:3.0:1788521554.967589:0:16550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521554.967685:0:16550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a4482f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788521554.967736:0:14415:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788521554.967750:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368165888 00000100:00100000:3.0:1788521554.967757:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368165888 00000100:00100000:3.0:1788521554.967888:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166016 00000100:00100000:3.0:1788521554.967892:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166016 00000100:00100000:3.0:1788521554.967904:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166144 00000100:00100000:3.0:1788521554.967906:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166144 00000100:00100000:3.0:1788521554.967918:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521554.967925:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+5:16550:x1875400368165888:12345-0@lo:104: 00010000:00010000:3.0:1788521554.967938:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.967986:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788521554.967992:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+5:16550:x1875400368165888:12345-0@lo:104: Request processed in 68us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521554.968000:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788521554.968017:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521554.968023:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+4:16550:x1875400368166016:12345-0@lo:104: 00010000:00010000:3.0:1788521554.968030:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.968060:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788521554.968065:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+4:16550:x1875400368166016:12345-0@lo:104: Request processed in 43us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521554.968070:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521554.968082:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521554.968087:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:16550:x1875400368166144:12345-0@lo:104: 00010000:00010000:3.0:1788521554.968101:0:14415:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.968426:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788521554.968433:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+3:16550:x1875400368166144:12345-0@lo:104: Request processed in 346us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521554.968440:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788521554.968504:0:16550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c094358aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368165888:0@lo:104: 00000100:00100000:3.0:1788521554.968513:0:16550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943588380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368166016:0@lo:104: 00000100:00100000:3.0:1788521554.968521:0:16550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943588000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368166144:0@lo:104: 00010000:00010000:1.0:1788521554.972369:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788521554.972383:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972394:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521554.972399:0:14421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972408:0:14421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521554.972416:0:14421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521554.972421:0:14421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788521554.972480:0:14421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972504:0:14421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788521554.972531:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972538:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0c00/0x53df1cebae0175d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0175e0 expref: -99 pid: 15834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972553:0:14421:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788521554.972557:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972563:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:1.0:1788521554.972566:0:14421:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.972574:0:14421:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788521554.972580:0:14421:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788521554.972584:0:14421:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521554.973062:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788521554.973070:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973077:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031400 already unused, calling callback (ffffffffc1ab4c20) 10000000:00010000:3.0:1788521554.973081:0:15698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973088:0:15698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788521554.973096:0:15698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788521554.973101:0:15698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788521554.973127:0:15698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973133:0:15698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788521554.973158:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973165:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a40031400/0x53df1cebae017451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae017458 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973175:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521554.973177:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788521554.973178:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521554.973186:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788521554.973202:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368166400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521554.973253:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521554.973334:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166400 00000100:00100000:0.0:1788521554.973341:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166400 00010000:00010000:0.0:1788521554.973367:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae017451 expref: 19 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521554.973401:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521554.973409:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368166400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788521554.973421:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521554.973426:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae017451 expref: 19 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521554.973436:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae017451 expref: 19 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521554.973450:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a48f6e000/0x53df1cebae017458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae017451 expref: 19 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521554.973472:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521554.973504:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:3303:x1875400368166400:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521554.973511:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788521554.973546:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368166400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521554.973698:0:14421:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.973705:0:14421:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788521554.973736:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368166528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788521554.973759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521554.973840:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166528 00000100:00100000:3.0:1788521554.973844:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166528 00010000:00010000:3.0:1788521554.973859:0:14418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.973876:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788521554.973881:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:3303:x1875400368166528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788521554.973888:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521554.973892:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973899:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973910:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40030600/0x53df1cebae0174a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae01749e expref: 18 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.973918:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521554.974047:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.974054:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e400/0x53df1cebae01749e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x53df1cebae0174a5 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.974072:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521554.974074:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521554.974076:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521554.974087:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3301:1875400368166272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788521554.974113:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521554.974296:0:14417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788521554.974305:0:14417:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788521554.974392:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166272 00000100:00100000:1.0:1788521554.974396:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166272 00010000:00010000:1.0:1788521554.974408:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521554.974420:0:14417:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788521554.974426:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521554.974431:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45a14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:3301:x1875400368166272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788521554.974437:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521554.974441:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.974449:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.974459:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a48f6e200/0x53df1cebae0175e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x53df1cebae0175d9 expref: 18 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521554.974467:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521554.974490:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45a14050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:3301:x1875400368166272:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521554.974504:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788521554.974528:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3301:1875400368166272:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788521554.976055:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521554.976443:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:3303:x1875400368166528:12345-0@lo:103:ldlm_bl.0 Request processed in 2556us (2677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521554.976455:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788521554.976685:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368166528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788521554.985311:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521554.985346:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521554.985475:0:16550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943588a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368165632:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521554.985487:0:16550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943588e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16550:1875400368165760:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521554.985519:0:16550:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521554.985586:0:16552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156544 00000100:00100000:2.0:1788521554.985686:0:16552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156544 00010000:00010000:2.0:1788521554.985730:0:16552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 13 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521554.985766:0:16552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156672 00000100:00100000:2.0:1788521554.985769:0:16552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156672 00010000:00010000:2.0:1788521554.985812:0:16552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 14 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521554.985835:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1788521554.985843:0:16552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a30bcea-542d-4612-9aa8-72900b2931cc+14:2346:x1875400346156544:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521554.985857:0:16552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521554.985864:0:16552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 14 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521554.985877:0:16552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 14 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521554.985882:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1788521554.985897:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a30bcea-542d-4612-9aa8-72900b2931cc+14:2346:x1875400346156672:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521554.985972:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40031000/0x53df1cebae017737 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644079f expref: 14 pid: 14426 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.985975:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521554.985985:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 14 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521554.985994:0:16552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521554.985998:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 13 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986010:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40030400/0x53df1cebae0176ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644073d expref: 13 pid: 14427 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986022:0:14418:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986030:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986046:0:14418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521554.986052:0:16552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3a30bcea-542d-4612-9aa8-72900b2931cc+12:2346:x1875400346156544:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 206us (748us total) trans 0 rc 0/0 00010000:00010000:3.0:1788521554.986058:0:14418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521554.986065:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00010000:00010000:3.0:1788521554.986073:0:14418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986088:0:14418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986095:0:14418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40030000 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521554.986099:0:14418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986106:0:14418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986120:0:14418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521554.986130:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521554.986153:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3a30bcea-542d-4612-9aa8-72900b2931cc+11:2346:x1875400346156672:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 260us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521554.986160:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00010000:00010000:0.0:1788521554.986286:0:16550:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521554.986294:0:16550:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521554.986300:0:16550:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0a40030000/0x53df1cebae017761 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16550 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521555.051489:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368166656:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.051556:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521555.051604:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368167168:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.051629:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521555.051654:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788521555.051672:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368166784:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.051695:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521555.051726:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368166912:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.051750:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521555.051769:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788521555.051798:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368167040:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.051820:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521555.051853:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166656 00000100:00100000:1.0:1788521555.051860:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166656 00000100:00100000:1.0:1788521555.051910:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166784 00000100:00100000:1.0:1788521555.051913:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166784 00000100:00100000:1.0:1788521555.051937:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521555.051945:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368166656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.051998:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368166656:12345-0@lo:400:kworker.0 Request processed in 53us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521555.052005:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788521555.052021:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521555.052027:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368166784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052063:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368166784:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521555.052069:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788521555.052094:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167168 00000100:00100000:1.0:1788521555.052098:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167168 00000100:00100000:1.0:1788521555.052117:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368166912 00000100:00100000:1.0:1788521555.052120:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368166912 00000100:00100000:1.0:1788521555.052130:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167040 00000100:00100000:1.0:1788521555.052132:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167040 00000100:00100000:1.0:1788521555.052146:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521555.052152:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368167168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052182:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368167168:12345-0@lo:400:kworker.0 Request processed in 30us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521555.052187:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788521555.052199:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521555.052203:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368166912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052229:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368166912:12345-0@lo:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521555.052234:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788521555.052244:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788521555.052248:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368167040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052287:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1875400368167040:12345-0@lo:400:kworker.0 Request processed in 38us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521555.052292:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788521555.052316:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521555.052321:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788521555.052324:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521555.052446:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1875400368167040:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052456:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368166912:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052482:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368166784:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052491:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368166656:0@lo:400:kworker.0 00000100:00100000:1.0:1788521555.052499:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368167168:0@lo:400:kworker.0 00000100:00100000:0.0:1788521555.053020:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368167296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521555.053057:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788521555.054604:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788521555.055521:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167296 00000100:00100000:1.0:1788521555.055531:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167296 00000100:00100000:1.0:1788521555.055582:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788521555.055592:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368167296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788521555.055627:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788521555.062029:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368167296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6429us (8962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521555.062043:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788521555.063494:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368167296:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788521556.073033:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521556.208068:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521556.208101:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156800 00000100:00100000:3.0:1788521556.208109:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156800 00000100:00100000:3.0:1788521556.208161:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:3.0:1788521556.208169:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+11:13752:x1875400346156800:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521556.208186:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521556.208205:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030400/0x53df1cebae017768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407d0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.208234:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030400/0x53df1cebae017768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407d0 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.208258:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030400/0x53df1cebae017768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407d0 expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.208267:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030400, rc 0) 00000100:00100000:3.0:1788521556.208317:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13752:x1875400346156800:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 148us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521556.208326:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:3.0:1788521556.212665:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521556.213003:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346156928 00000100:00100000:1.0:1788521556.213013:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346156928 00000100:00100000:1.0:1788521556.213168:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:1.0:1788521556.213178:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13752:x1875400346156928:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521556.213457:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13752:x1875400346156928:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 279us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521556.213465:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:3.0:1788521556.227118:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521556.227152:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157056 00000100:00100000:3.0:1788521556.227162:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157056 00000100:00100000:3.0:1788521556.227215:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:3.0:1788521556.227225:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13752:x1875400346157056:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521556.227419:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13752:x1875400346157056:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 195us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521556.227427:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:1.0:1788521556.249159:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521556.249367:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157184 00000100:00100000:3.0:1788521556.249376:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157184 00000100:00100000:3.0:1788521556.249432:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:3.0:1788521556.249442:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+12:13752:x1875400346157184:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521556.249457:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521556.249475:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030600/0x53df1cebae01776f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407d7 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.249502:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030600/0x53df1cebae01776f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407d7 expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.249523:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030600/0x53df1cebae01776f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407d7 expref: 13 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.249532:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030600, rc 0) 00000100:00100000:3.0:1788521556.249692:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13752:x1875400346157184:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 251us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521556.249700:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:2.0:1788521556.254028:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521556.254064:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157312 00000100:00100000:2.0:1788521556.254073:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157312 00000100:00100000:2.0:1788521556.254119:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:2.0:1788521556.254128:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13752:x1875400346157312:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521556.262512:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13752:x1875400346157312:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 8374us (8481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521556.262527:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:0.0:1788521556.269715:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521556.269933:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157440 00000100:00100000:2.0:1788521556.269950:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157440 00000100:00100000:2.0:1788521556.270003:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:2.0:1788521556.270014:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13752:x1875400346157440:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788521556.270236:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+13:13752:x1875400346157440:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 224us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521556.270244:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:2.0:1788521556.590961:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368167424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788521556.591030:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.591176:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167424 00000100:00100000:0.0:1788521556.591183:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167424 00000100:00100000:0.0:1788521556.591234:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788521556.591243:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368167424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788521556.591276:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788521556.591320:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941356300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368167424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521556.591326:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788521556.591399:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368167424:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788521556.906678:0:14429:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788521556.906685:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a5104d800 from 10 10000000:01000000:2.0:1788521556.906691:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788521556.906736:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521556.906746:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521556.906757:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521556.906799:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788521556.906875:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521556.908364:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a65dd2540 going to sleep for 11 seconds 00000100:00100000:3.0:1788521556.908468:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167552 00000100:00100000:3.0:1788521556.908476:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167552 00000100:00100000:3.0:1788521556.908583:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788521556.908594:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+16:14429:x1875400368167552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788521556.908609:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521556.908625:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a40030800/0x53df1cebae01777d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017776 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.908659:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a40030800/0x53df1cebae01777d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017776 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.908671:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a40030800/0x53df1cebae01777d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017776 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521556.908679:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030800, rc 0) 00000100:00100000:3.0:1788521556.909626:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:14429:x1875400368167552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1031us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521556.909634:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788521556.918410:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521556.918440:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01777d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.918452:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01777d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521556.918530:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.918589:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.918627:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521556.918674:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167680 00000100:00100000:0.0:1788521556.918679:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167680 00000100:00100000:0.0:1788521556.918723:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521556.918733:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:14429:x1875400368167680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.918979:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:14429:x1875400368167680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521556.918995:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788521556.919035:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.919061:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.919132:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.919149:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788521556.919160:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167808 00000100:00100000:0.0:1788521556.919164:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167808 00000100:00100000:0.0:1788521556.919187:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788521556.919196:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:14429:x1875400368167808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.919351:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:14429:x1875400368167808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521556.919357:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788521556.919393:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788521556.920024:0:16644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788521556.920075:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788521556.920087:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521556.920096:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01777d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920106:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a439a0000/0x53df1cebae017776 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01777d expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521556.920115:0:14429:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521556.920117:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c0a79c76000 from 10 10000000:01000000:0.0:1788521556.920120:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521556.920146:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920161:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920172:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521556.920187:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.920224:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.920242:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521556.920258:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368167936 00000100:00100000:0.0:1788521556.920263:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368167936 00000100:00100000:0.0:1788521556.920290:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788521556.920296:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+17:14429:x1875400368167936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521556.920306:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521556.920318:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01778b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017784 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920338:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01778b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017784 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920348:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a48f6ee00/0x53df1cebae01778b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017784 expref: 18 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920357:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6ee00, rc 0) 00000100:00100000:0.0:1788521556.920388:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368167936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521556.920394:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788521556.920436:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368167936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788521556.920448:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01778b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.920456:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae01778b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521556.920493:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.920515:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.920527:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521556.920539:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368168064 00000100:00100000:0.0:1788521556.920542:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368168064 00000100:00100000:0.0:1788521556.920560:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788521556.920565:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368168064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.920765:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368168064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521556.920793:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788521556.920823:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.920848:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.920883:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.920896:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788521556.920906:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368168192 00000100:00100000:0.0:1788521556.920910:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368168192 00000100:00100000:0.0:1788521556.920931:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788521556.920938:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368168192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.921055:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368168192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521556.921068:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788521556.921102:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788521556.930918:0:16645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788521556.931088:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788521556.931107:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521556.931118:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01778b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.931140:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6f000/0x53df1cebae017784 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae01778b expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788521556.931151:0:14429:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788521556.931154:0:14429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8c09434dd000 from 10 10000000:01000000:0.0:1788521556.931157:0:14429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788521556.931192:0:14429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.931201:0:14429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.931212:0:14429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521556.931345:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788521556.931403:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521556.931456:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a7f1e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788521556.931505:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368168320 00000100:00100000:1.0:1788521556.931513:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368168320 00000100:00100000:1.0:1788521556.931572:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788521556.931580:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+18:14429:x1875400368168320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788521556.931593:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521556.931605:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0a6f325400/0x53df1cebae017799 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x53df1cebae017792 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521556.931628:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0a6f325400/0x53df1cebae017799 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x53df1cebae017792 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521556.931638:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0a6f325400/0x53df1cebae017799 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x53df1cebae017792 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521556.931658:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f325400, rc 0) 00000100:00100000:1.0:1788521556.931793:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f2f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368168320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521556.931800:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788521556.932909:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788521556.932931:0:14429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017799 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521556.932943:0:14429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x53df1cebae017799 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521556.933005:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788521556.933047:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521556.933082:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a65dd29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521556.933100:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368168448 00000100:00100000:0.0:1788521556.933107:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368168448 00000100:00100000:0.0:1788521556.933148:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788521556.933157:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368168448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788521556.939583:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368168448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6419us (6527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521556.939597:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788521556.940949:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0941357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788521556.941024:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943589f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788521556.941091:0:14429:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521556.941140:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a51f77180 going to sleep for 11 seconds 00000100:00100000:1.0:1788521556.941145:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368168576 00000100:00100000:1.0:1788521556.941153:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368168576 00000100:00100000:1.0:1788521556.942538:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788521556.942555:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368168576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788521556.942922:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:14429:x1875400368168576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521556.942931:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788521556.947636:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943589f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:14429:1875400368168576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788521556.951185:0:16647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788521556.951347:0:14429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788521556.951369:0:14429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788521556.951381:0:14429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017799 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521556.951394:0:14429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8c0a48f6e600/0x53df1cebae017792 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x53df1cebae017799 expref: -99 pid: 14429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521557.098049:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788521557.481469:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788521558.121977:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521558.138249:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.138433:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.138481:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.138719:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.138745:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521558.139725:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157696 00000100:00100000:1.0:1788521558.139856:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157696 00000100:00100000:1.0:1788521558.139922:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1788521558.139933:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2345:x1875400346157696:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521558.140019:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2345:x1875400346157696:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 84us (1776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.140027:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1788521558.140073:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157568 00000100:00100000:1.0:1788521558.140077:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157568 00000100:00100000:1.0:1788521558.140104:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1788521558.140111:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75516c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:2345:x1875400346157568:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521558.140139:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75516c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3a30bcea-542d-4612-9aa8-72900b2931cc+13:2345:x1875400346157568:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.140145:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00080000:1.0:1788521558.140170:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521558.140911:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.140937:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521558.140985:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157952 00000100:00100000:3.0:1788521558.140999:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157952 00000100:00100000:1.0:1788521558.141032:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158208 00000100:00100000:1.0:1788521558.141048:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158208 00000100:00100000:1.0:1788521558.141086:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346157824 00000100:00100000:1.0:1788521558.141090:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346157824 00000100:00100000:3.0:1788521558.141107:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1788521558.141123:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2345:x1875400346157952:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521558.141133:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1788521558.141146:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2345:x1875400346158208:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521558.141316:0:15116:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788521558.141327:0:15116:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1788521558.141386:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2345:x1875400346157952:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 104us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521558.141400:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1788521558.141429:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1788521558.141440:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2345:x1875400346157824:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1788521558.141827:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158080 00000100:00100000:0.0:1788521558.141845:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158080 00000100:00100000:0.0:1788521558.141885:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1788521558.141894:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0941357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2345:x1875400346158080:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521558.142184:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2345:x1875400346158208:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 1039us (3701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.142192:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1788521558.142209:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158336 00000100:00100000:1.0:1788521558.142213:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158336 00000100:00100000:1.0:1788521558.142236:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1788521558.142242:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2345:x1875400346158336:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521558.142273:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2345:x1875400346158336:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.142279:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00080000:1.0:1788521558.142436:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521558.142440:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788521558.142442:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788521558.145395:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2345:x1875400346157824:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 3933us (6622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521558.145413:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1788521558.145723:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0941357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2345:x1875400346158080:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 3819us (4804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521558.145739:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1788521558.576136:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.576284:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158464 00000100:00100000:2.0:1788521558.576299:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158464 00000100:00100000:1.0:1788521558.578289:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1788521558.578323:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:14411:x1875400346158464:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521558.578352:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521558.578381:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407de expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578469:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578487:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578501:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578520:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578528:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578535:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.578991:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325e00/0x53df1cebae0177b5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579003:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325e00/0x53df1cebae0177b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579011:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325e00/0x53df1cebae0177b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521558.579043:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521558.579047:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521558.579094:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325e00/0x53df1cebae0177b5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579107:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579115:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579122:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579128:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521558.579135:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579144:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579158:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.579168:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521558.579174:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579182:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579197:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579202:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579208:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579213:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f324e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521558.579215:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579221:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579229:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c0a4395fe00) 00010000:00010000:1.0:1788521558.579231:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521558.579234:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579240:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579283:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407de expref: 8 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579312:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325e00/0x53df1cebae0177b5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407de expref: 7 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.579321:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c0a4395f900) 00010000:00010000:1.0:1788521558.579323:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521558.579326:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f325e00, rc 0) 00000100:00100000:1.0:1788521558.581808:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:14411:x1875400346158464:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 3484us (5666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.581824:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:2.0:1788521558.596902:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521558.597084:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158720 00000100:00100000:0.0:1788521558.597101:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158720 00000100:00100000:0.0:1788521558.597184:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1788521558.597196:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:14411:x1875400346158720:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521558.597236:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521558.597265:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0177bc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407e5 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.597366:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.597402:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.597418:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600081:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600110:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600125:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600492:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae0177d1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600503:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae0177d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600510:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae0177d1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521558.600522:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788521558.600738:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.600745:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601299:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601317:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521558.601322:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601330:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601343:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c0a4395f900) 00010000:00010000:0.0:1788521558.601347:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521558.601351:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601357:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0177c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601371:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601377:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601383:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601387:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521558.601390:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601395:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601411:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c0a4fa31c00) 00010000:00010000:0.0:1788521558.601413:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521558.601415:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.601421:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0177ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.602428:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0177bc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407e5 expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.602451:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e200/0x53df1cebae0177d1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407e5 expref: 9 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.602461:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a4fa31900) 00010000:00010000:0.0:1788521558.602464:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521558.602467:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e200, rc 0) 00000100:00100000:0.0:1788521558.602685:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14411:x1875400346158720:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 5489us (5787us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788521558.602693:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1788521558.619259:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521558.619573:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158848 00000100:00100000:1.0:1788521558.619583:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158848 00000100:00100000:1.0:1788521558.619656:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1788521558.619667:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14411:x1875400346158848:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788521558.619848:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14411:x1875400346158848:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 182us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.619856:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1788521558.631474:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521558.632175:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346158976 00000100:00100000:1.0:1788521558.632187:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346158976 00000100:00100000:1.0:1788521558.632299:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1788521558.632310:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14417:x1875400346158976:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521558.632331:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521558.632353:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407ec expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.632416:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.632442:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.632454:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.632470:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.632477:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.632484:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638156:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638172:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638180:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638187:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f324e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521558.638191:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638199:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638217:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.638228:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521558.638234:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638241:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324e00/0x53df1cebae0177e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638254:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638260:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638266:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638271:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521558.638273:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638279:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638287:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c0a4395fe00) 00010000:00010000:1.0:1788521558.638289:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521558.638292:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638297:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae0177ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638342:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407ec expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638362:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.638364:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521558.638369:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407ec expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.638379:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f325a00, rc 0) 00000100:00100000:1.0:1788521558.638456:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14417:x1875400346158976:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 6147us (6989us total) trans 0 rc 301/301 00000100:00100000:1.0:1788521558.638464:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1788521558.642908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.643121:0:14440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346159104 00000100:00100000:2.0:1788521558.643135:0:14440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346159104 00000100:00100000:2.0:1788521558.643198:0:14440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1788521558.643209:0:14440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14417:x1875400346159104:12345-192.168.203.48@tcp:700:lfs.0 00000100:00100000:2.0:1788521558.643316:0:14440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14417:x1875400346159104:12345-192.168.203.48@tcp:700:lfs.0 Request processed in 109us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521558.643325:0:14440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521558.653745:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.653865:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346159360 00000100:00100000:2.0:1788521558.653879:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346159360 00000100:00100000:1.0:1788521558.654040:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1788521558.654053:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14417:x1875400346159360:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:1.0:1788521558.654120:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521558.654148:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae017722 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440767 expref: 9 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.654168:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.654173:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788521558.654377:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.654391:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 5 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.654400:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.654446:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 5 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.654461:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 5 pid: 14432 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521558.654475:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1875400368168704:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521558.654583:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788521558.672329:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d19f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1875400368168704:192.168.203.48@tcp:104: 00010000:00010000:1.0:1788521558.672362:0:14433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521558.674893:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521558.675037:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346159488 00000100:00100000:0.0:1788521558.675053:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346159488 00010000:00010000:0.0:1788521558.675175:0:14418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 6 pid: 14432 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521558.675224:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1788521558.675234:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2345:x1875400346159488:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521558.675265:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521558.675273:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 6 pid: 14432 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.675288:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 6 pid: 14432 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.675310:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae01775a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407c9 expref: 6 pid: 14432 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.675327:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:0.0:1788521558.675332:0:14418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.675342:0:14418:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.675349:0:14418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.675478:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521558.675545:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2345:x1875400346159488:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 312us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521558.675553:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00010000:00010000:1.0:1788521558.681997:0:14433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.682014:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.682073:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.682087:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.682100:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521558.688492:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788521558.688522:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.688534:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.688542:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.688548:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325a00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521558.688553:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.688562:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.688582:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.688586:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521558.688591:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.688598:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae0177f4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788521558.688620:0:14433:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf7a06cd reply state 00000000064d300d transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521558.688629:0:14433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788521558.689507:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+10:14417:x1875400346159360:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 35449us (35769us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788521558.689518:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:0.0:1788521558.694881:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.694898:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.695039:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.695045:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521558.695051:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.695059:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.695076:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c0a4395fe00) 00010000:00010000:0.0:1788521558.695079:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521558.695084:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.695090:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0177fb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521558.845531:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521558.845729:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346159616 00000100:00100000:1.0:1788521558.845764:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346159616 00000100:00100000:1.0:1788521558.845888:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521558.845901:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:14425:x1875400346159616:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:1.0:1788521558.845935:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521558.845966:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae017802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407f3 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.846053:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae017809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.846070:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae017809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.846085:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae017809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521558.846134:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788521558.846140:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788521558.846187:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae017809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.846219:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae017802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407f3 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.846243:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325000/0x53df1cebae017809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407f3 expref: 10 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.846253:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.846256:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788521558.846260:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f325000, rc 0) 00000100:00100000:1.0:1788521558.846352:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+10:14425:x1875400346159616:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 453us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521558.846360:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521558.884941:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521558.885057:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346159744 00000100:00100000:3.0:1788521558.885071:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346159744 00000100:00100000:3.0:1788521558.885146:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1788521558.885178:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:14426:x1875400346159744:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521558.885206:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521558.885237:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae017810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a64407fa expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.885321:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.885352:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.885371:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521558.885415:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521558.885419:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521558.885445:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.885473:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae017810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407fa expref: 7 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.885497:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40030000/0x53df1cebae017817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a64407fa expref: 6 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.885507:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:3.0:1788521558.885511:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521558.885515:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a40030000, rc 0) 00000100:00100000:3.0:1788521558.885594:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:14426:x1875400346159744:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 419us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521558.885612:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1788521558.891908:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521558.892028:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346159872 00000100:00100000:3.0:1788521558.892038:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346159872 00000100:00100000:3.0:1788521558.892106:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1788521558.892117:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:14426:x1875400346159872:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1788521558.892138:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521558.892162:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae01781e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440801 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892227:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892242:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892254:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892270:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892278:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892285:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892404:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea000/0x53df1cebae017833 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892431:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea000/0x53df1cebae017833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892439:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea000/0x53df1cebae017833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521558.892472:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788521558.892475:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788521558.892493:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea000/0x53df1cebae017833 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892505:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892512:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892519:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892526:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a40031000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521558.892530:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892538:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892551:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:3.0:1788521558.892554:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521558.892559:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892576:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031000/0x53df1cebae017825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892591:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892597:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892603:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892609:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bebc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521558.892612:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892618:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892626:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c0a65ff4400) 00010000:00010000:3.0:1788521558.892628:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521558.892643:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892650:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01782c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892682:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a40031400/0x53df1cebae01781e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440801 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892720:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea000/0x53df1cebae017833 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440801 expref: 7 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521558.892728:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:3.0:1788521558.892731:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788521558.892733:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bea000, rc 0) 00000100:00100000:3.0:1788521558.892853:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+7:14426:x1875400346159872:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 738us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521558.892861:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1788521558.897297:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521558.897396:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346160128 00000100:00100000:1.0:1788521558.897410:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346160128 00000100:00100000:1.0:1788521558.897486:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1788521558.897499:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+7:14426:x1875400346160128:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1788521558.897529:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521558.897559:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae01783a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440808 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788521558.897713:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788521558.897970:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae01783a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440808 expref: 9 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.897990:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:1.0:1788521558.897994:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788521558.898000:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325a00/0x53df1cebae01783a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440808 expref: 9 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.898018:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f325a00, rc 0) 00000100:00100000:1.0:1788521558.898107:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+8:14426:x1875400346160128:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 610us (826us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788521558.898116:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1788521558.900448:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.900552:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346160384 00000100:00100000:2.0:1788521558.900566:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346160384 00000100:00100000:2.0:1788521558.900664:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:2.0:1788521558.900675:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+8:14426:x1875400346160384:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:2.0:1788521558.900741:0:14433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521558.900814:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea000/0x53df1cebae017833 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440801 expref: 8 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521558.900841:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a65ff4d00) 00010000:00010000:2.0:1788521558.900854:0:14433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788521558.900886:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521558.900901:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521558.900912:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521558.901182:0:14433:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000027ec3ed4 reply state 00000000a0fbb78f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521558.901193:0:14433:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788521558.901220:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788521558.901329:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+9:14426:x1875400346160384:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 655us (893us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788521558.901338:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1788521558.904705:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1788521558.905389:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.905427:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.905436:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.905443:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0e00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521558.905449:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.905458:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.905480:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:1.0:1788521558.905483:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788521558.905489:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521558.905495:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae017848 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521558.905750:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346160640 00000100:00100000:3.0:1788521558.905947:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346160640 00000100:00100000:3.0:1788521558.906022:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:3.0:1788521558.906035:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+8:14426:x1875400346160640:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1788521558.906369:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+9:14426:x1875400346160640:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 337us (1679us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788521558.906379:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:3.0:1788521558.911230:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521558.911356:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346160896 00000100:00100000:0.0:1788521558.911369:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346160896 00000100:00100000:0.0:1788521558.911441:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1788521558.911453:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+9:14426:x1875400346160896:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521558.911484:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521558.911510:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae01784f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644080f expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.911630:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.911657:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.911670:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.911688:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.911696:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.911703:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521558.911903:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788521558.912009:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912018:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912025:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912030:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fe00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521558.912034:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912052:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912065:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:0.0:1788521558.912068:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521558.912073:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912079:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fe00/0x53df1cebae017856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912093:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912099:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912105:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912109:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521558.912111:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912116:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912121:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c0a4fa31c00) 00010000:00010000:0.0:1788521558.912123:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521558.912125:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912138:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01785d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912177:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae01784f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644080f expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912187:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:0.0:1788521558.912189:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788521558.912193:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae01784f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644080f expref: 11 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.912202:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e400, rc 0) 00000100:00100000:0.0:1788521558.912275:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+10:14426:x1875400346160896:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 825us (1061us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788521558.912283:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:1.0:1788521558.915299:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521558.915376:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346161024 00000100:00100000:0.0:1788521558.915389:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346161024 00000100:00100000:0.0:1788521558.915458:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:0.0:1788521558.915470:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+10:14426:x1875400346161024:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521558.915501:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521558.915531:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae01786b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440816 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.915655:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.915674:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.915704:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521558.915736:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788521558.915740:0:14432:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521558.915866:0:14432:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.915899:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae01786b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 12 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.915921:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521558.915929:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a4fa31100) 00010000:00010000:0.0:1788521558.915932:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788521558.915937:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6fa00, rc 0) 00000100:00100000:0.0:1788521558.916100:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+11:14426:x1875400346161024:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 633us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521558.916106:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1788521558.922339:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521558.922479:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346161152 00000100:00100000:0.0:1788521558.922490:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346161152 00000100:00100000:0.0:1788521558.922555:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1788521558.922568:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+11:14426:x1875400346161152:12345-192.168.203.48@tcp:37:lfs.0 00000100:00100000:0.0:1788521558.938756:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d3d61bb-199f-444a-897c-ee821b4c8e79+11:14426:x1875400346161152:12345-192.168.203.48@tcp:37:lfs.0 Request processed in 16163us (16402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521558.938815:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:1.0:1788521558.946591:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521558.947035:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346161408 00000100:00100000:2.0:1788521558.947048:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346161408 00000100:00100000:2.0:1788521558.947115:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1788521558.947124:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a488e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+11:14426:x1875400346161408:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521558.949984:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a488e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d3d61bb-199f-444a-897c-ee821b4c8e79+12:14426:x1875400346161408:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 2848us (3394us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788521558.949996:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1788521559.021185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.021439:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346161536 00000100:00100000:2.0:1788521559.021453:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346161536 00000100:00100000:2.0:1788521559.021536:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1788521559.021549:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+10:14432:x1875400346161536:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1788521559.021576:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521559.021604:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae017879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644081d expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021698:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021717:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021735:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021763:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021843:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021851:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021966:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0800/0x53df1cebae01788e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021975:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0800/0x53df1cebae01788e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.021982:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0800/0x53df1cebae01788e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521559.022016:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788521559.022020:0:14433:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788521559.022065:0:14433:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0800/0x53df1cebae01788e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022079:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022086:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022093:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022100:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521559.022105:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022119:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022133:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:2.0:1788521559.022136:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521559.022142:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022149:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae017880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022165:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022171:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022189:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022196:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0c00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521559.022198:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022204:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022212:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c0a46737200) 00010000:00010000:2.0:1788521559.022215:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521559.022217:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022233:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae017887 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022411:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae017879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644081d expref: 12 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022429:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0800/0x53df1cebae01788e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644081d expref: 11 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.022437:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a4fa31100) 00010000:00010000:2.0:1788521559.022440:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788521559.022443:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0800, rc 0) 00000100:00100000:2.0:1788521559.022516:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+11:14432:x1875400346161536:12345-192.168.203.48@tcp:101:bash.0 Request processed in 968us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521559.022525:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1788521559.026730:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.027393:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346161792 00000100:00100000:0.0:1788521559.027410:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346161792 00000100:00100000:1.0:1788521559.027651:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1788521559.027667:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+11:14432:x1875400346161792:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1788521559.027698:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521559.027730:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325c00/0x53df1cebae017895 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440824 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.027973:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.027994:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.028004:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.028052:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 11 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.028069:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 11 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521559.028087:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1875400368168832:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521559.028547:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521559.033107:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.033428:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1875400368168832:192.168.203.48@tcp:104: 00010000:00010000:2.0:1788521559.033472:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521559.033572:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346161920 00000100:00100000:0.0:1788521559.033580:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346161920 00010000:00010000:0.0:1788521559.033627:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 12 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521559.033673:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1788521559.033684:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+12:2345:x1875400346161920:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521559.033701:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521559.033709:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 12 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.033722:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 12 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.033904:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017872 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440816 expref: 12 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.033923:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a4fa31100) 00010000:00010000:0.0:1788521559.033929:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.033940:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.033949:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.034019:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521559.034112:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+11:2345:x1875400346161920:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 428us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521559.034121:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00010000:00010000:2.0:1788521559.035116:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.035130:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.035160:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.035189:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.035199:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037106:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037130:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037144:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521559.037160:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521559.037200:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037208:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037216:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037222:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f324a00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521559.037228:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037237:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037342:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a4fa31100) 00010000:00010000:2.0:1788521559.037345:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788521559.037351:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037358:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324a00/0x53df1cebae01789c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788521559.037375:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002902d1d3 reply state 00000000b586e60f transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521559.037386:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788521559.037431:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325c00/0x53df1cebae017895 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 14 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037449:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 13 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.037457:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521559.037459:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788521559.037462:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0c00, rc 0) 00000100:00100000:2.0:1788521559.037923:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+14:14432:x1875400346161792:12345-192.168.203.48@tcp:101:bash.0 Request processed in 10257us (11207us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788521559.037934:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00010000:00010000:3.0:1788521559.044409:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.044434:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.044467:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.044474:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521559.044481:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.044490:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.044512:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c0a46737200) 00010000:00010000:3.0:1788521559.044515:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788521559.044522:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.044529:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae0178a3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521559.071187:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.072289:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346162048 00000100:00100000:0.0:1788521559.072308:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346162048 00000100:00100000:0.0:1788521559.072401:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1788521559.072415:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+13:14432:x1875400346162048:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1788521559.072454:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521559.072483:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0178b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644082b expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.072576:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.072594:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.072609:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521559.072670:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788521559.072675:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521559.072701:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.072714:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.072745:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0178b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 15 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.073121:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 14 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.073131:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521559.073135:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521559.073140:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e000, rc 0) 00000100:00100000:0.0:1788521559.073229:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+14:14432:x1875400346162048:12345-192.168.203.48@tcp:101:bash.0 Request processed in 817us (2056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521559.073238:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:1.0:1788521559.076939:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.077092:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346162304 00000100:00100000:0.0:1788521559.077105:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346162304 00000100:00100000:0.0:1788521559.077189:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1788521559.077201:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+14:14432:x1875400346162304:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1788521559.077710:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+15:14432:x1875400346162304:12345-192.168.203.48@tcp:35:bash.0 Request processed in 508us (782us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788521559.077720:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00010000:00010000:0.0:1788521559.145172:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521559.210896:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.212415:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346162560 00000100:00100000:2.0:1788521559.212446:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346162560 00000100:00100000:2.0:1788521559.212548:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:2.0:1788521559.212562:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+15:14442:x1875400346162560:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1788521559.212619:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521559.212659:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440832 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521559.212846:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788521559.213012:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440832 expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.213032:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0a4395fd00) 00010000:00010000:2.0:1788521559.213035:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521559.213042:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440832 expref: 17 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.213061:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1000, rc 0) 00000100:00100000:2.0:1788521559.213150:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+16:14442:x1875400346162560:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 590us (2269us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788521559.213158:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:3.0:1788521559.217156:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.226048:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346162816 00000100:00100000:0.0:1788521559.226073:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346162816 00000100:00100000:0.0:1788521559.226357:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1788521559.226373:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+16:14442:x1875400346162816:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1788521559.229295:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+17:14442:x1875400346162816:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 2806us (12033us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788521559.229312:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1788521559.309512:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.309704:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346163072 00000100:00100000:0.0:1788521559.309718:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346163072 00000100:00100000:0.0:1788521559.309853:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:0.0:1788521559.309866:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+17:14445:x1875400346163072:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1788521559.309897:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521559.309924:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0178d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440839 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.310059:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0178db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.310077:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0178db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.310093:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0178db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521559.310107:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788521559.310333:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae0178d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440839 expref: 20 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.310359:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0178db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440839 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.310369:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521559.310373:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788521559.310377:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e400, rc 0) 00000100:00100000:0.0:1788521559.310476:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14445:x1875400346163072:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 613us (979us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788521559.310494:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1788521559.318365:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521559.318419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.319225:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346163200 00000100:00100000:2.0:1788521559.319240:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346163200 00000100:00100000:2.0:1788521559.319322:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:2.0:1788521559.319335:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14445:x1875400346163200:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1788521559.319430:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319453:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319468:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319523:0:14433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319532:0:14433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319540:0:14433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319547:0:14433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a1000 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:2.0:1788521559.319553:0:14433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319562:0:14433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319578:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521559.319582:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788521559.319588:0:14433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.319595:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521559.319718:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14445:x1875400346163200:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 384us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521559.319725:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:1.0:1788521559.320246:0:16552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346163328 00000100:00100000:1.0:1788521559.320254:0:16552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346163328 00000100:00100000:1.0:1788521559.320306:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1788521559.320317:0:16552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:2345:x1875400346163328:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521559.320334:0:16552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521559.320354:0:16552:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae0178db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440839 expref: 19 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.320383:0:16552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521559.320387:0:16552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521559.320434:0:16552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+18:2345:x1875400346163328:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 119us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521559.320441:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521559.322107:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.322319:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346163584 00000100:00100000:2.0:1788521559.322332:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346163584 00000100:00100000:2.0:1788521559.322395:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1788521559.322424:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+18:14445:x1875400346163584:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1788521559.322909:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14445:x1875400346163584:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 488us (813us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788521559.322918:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000040:00080000:0.0:1788521559.529593:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788521559.676569:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.676725:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346163840 00000100:00100000:2.0:1788521559.676739:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346163840 00000100:00100000:2.0:1788521559.676937:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:2.0:1788521559.676950:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14476:x1875400346163840:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1788521559.676987:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521559.677016:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440840 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.677164:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae0178f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.677183:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae0178f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.677199:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae0178f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788521559.677230:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788521559.677425:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae0178f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440840 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.677448:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae0178f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440840 expref: 21 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.677481:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521559.677484:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521559.677488:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1800, rc 0) 00000100:00100000:2.0:1788521559.677574:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:14476:x1875400346163840:12345-192.168.203.48@tcp:101:cat.0 Request processed in 627us (1019us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788521559.677583:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1788521559.692362:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521559.692681:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.693556:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346164096 00000100:00100000:2.0:1788521559.693575:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346164096 00000100:00100000:2.0:1788521559.697019:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1788521559.697380:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:2348:x1875400346164096:12345-192.168.203.48@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788521559.697602:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346164224 00000100:00100000:0.0:1788521559.697619:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346164224 00000100:00100000:0.0:1788521559.698188:0:14434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1788521559.698201:0:14434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+22:14476:x1875400346164224:12345-192.168.203.48@tcp:35:cat.0 00010000:00010000:2.0:1788521559.698204:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521559.698254:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae0178f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440840 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.698473:0:14417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521559.698480:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521559.698638:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+22:2348:x1875400346164096:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1289us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521559.698648:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:0.0:1788521559.698973:0:14434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:14476:x1875400346164224:12345-192.168.203.48@tcp:35:cat.0 Request processed in 774us (6625us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788521559.698981:0:14434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1788521559.753165:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.753440:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346164480 00000100:00100000:2.0:1788521559.753451:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346164480 00000100:00100000:2.0:1788521559.753526:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:2.0:1788521559.753537:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:14482:x1875400346164480:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:2.0:1788521559.753562:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521559.753582:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017905 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440847 expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.753708:0:14433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.753724:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.753732:0:14433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.753741:0:14433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.753819:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 22 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.753834:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 22 pid: 14431 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521559.753850:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1875400368168960:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521559.754101:0:14433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521559.754124:0:14433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521559.754143:0:14433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1875400368169088:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521559.754183:0:14433:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a65dd2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788521559.767248:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521559.767436:0:16552:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346164608 00000100:00100000:1.0:1788521559.767452:0:16552:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346164608 00010000:00010000:1.0:1788521559.767510:0:16552:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 23 pid: 14431 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521559.767558:0:16552:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1788521559.767566:0:16552:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a45a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+23:2346:x1875400346164608:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521559.767582:0:16552:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521559.767587:0:16552:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 23 pid: 14431 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.767600:0:16552:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 23 pid: 14431 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.767623:0:16552:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521559.767638:0:16552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.767649:0:16552:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.767676:0:16552:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521559.767982:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0178bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644082b expref: 23 pid: 14431 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521559.768010:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fff480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1875400368168960:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521559.768028:0:16552:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a45a17c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+22:2346:x1875400346164608:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 454us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521559.768044:0:16552:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1788521559.768044:0:14433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14433:1875400368169088:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521559.768100:0:14433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521559.770889:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521559.770960:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346164736 00000100:00100000:1.0:1788521559.770969:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346164736 00010000:00010000:1.0:1788521559.771007:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521559.771371:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1788521559.771384:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+22:2345:x1875400346164736:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521559.771400:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521559.771407:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.771422:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.771447:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0c00/0x53df1cebae0178aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440824 expref: 22 pid: 14432 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.771532:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521559.771538:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.771549:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.771569:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.771713:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788521559.771804:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:2345:x1875400346164736:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 422us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521559.771812:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00010000:00010000:0.0:1788521559.776646:0:14433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.776663:0:14433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14433 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521559.776686:0:14433:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788521559.777352:0:14433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017905 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440847 expref: 22 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.777394:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1000/0x53df1cebae01790c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440847 expref: 21 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.777404:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521559.777407:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788521559.777411:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1000, rc 0) 00000100:00100000:0.0:1788521559.777491:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:14482:x1875400346164480:12345-192.168.203.48@tcp:101:dd.0 Request processed in 23955us (24335us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788521559.777499:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1788521559.783592:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.783691:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346164992 00000100:00100000:2.0:1788521559.783702:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346164992 00000100:00100000:2.0:1788521559.783815:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1788521559.783826:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:14482:x1875400346164992:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:2.0:1788521559.784540:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.784560:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.784585:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788521559.784658:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788521559.784697:0:14432:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006185b811 reply state 00000000a7ade047 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521559.784707:0:14432:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788521559.784830:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14482:x1875400346164992:12345-192.168.203.48@tcp:36:dd.0 Request processed in 1004us (1245us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788521559.784838:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000020:00080000:2.0:1788521559.784842:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788521559.789720:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.789741:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.789750:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.789756:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0600 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521559.789761:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.789769:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.789821:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521559.789824:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521559.789829:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.789850:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0600/0x53df1cebae01791a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521559.798330:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.798591:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346165120 00000100:00100000:0.0:1788521559.798601:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346165120 00000100:00100000:0.0:1788521559.798675:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1788521559.798685:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+23:14482:x1875400346165120:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:0.0:1788521559.798708:0:14433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521559.798727:0:14433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae017921 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644084e expref: -99 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.798810:0:14433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae017921 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644084e expref: 24 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.798825:0:14433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae017921 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644084e expref: 24 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.798844:0:14433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521559.798846:0:14433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521559.798849:0:14433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e000, rc 0) 00000100:00100000:0.0:1788521559.798899:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14482:x1875400346165120:12345-192.168.203.48@tcp:101:dd.0 Request processed in 216us (2125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521559.798905:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:1.0:1788521559.826048:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521559.826217:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346165376 00000100:00100000:2.0:1788521559.826228:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346165376 00000100:00100000:2.0:1788521559.826295:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1788521559.826306:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14482:x1875400346165376:12345-192.168.203.48@tcp:103:dd.0 00010000:00010000:2.0:1788521559.826320:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521559.826346:0:14418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae017921 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644084e expref: 24 pid: 14433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521559.826366:0:14418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:2.0:1788521559.826371:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521559.826439:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+23:14482:x1875400346165376:12345-192.168.203.48@tcp:103:dd.0 Request processed in 134us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521559.826455:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:3.0:1788521559.830226:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521559.830332:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346165504 00000100:00100000:0.0:1788521559.830342:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346165504 00000100:00100000:0.0:1788521559.830400:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:0.0:1788521559.830410:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+23:14482:x1875400346165504:12345-192.168.203.48@tcp:58:dd.0 00010000:00010000:0.0:1788521559.830589:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.830607:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521559.830619:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521559.834687:0:14431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788521559.837119:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788521559.837224:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788521559.837412:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+23:14482:x1875400346165504:12345-192.168.203.48@tcp:58:dd.0 Request processed in 6997us (7188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521559.837426:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:0.0:1788521559.846659:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521559.849077:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346165632 00000100:00100000:1.0:1788521559.849092:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346165632 00000100:00100000:1.0:1788521559.849163:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1788521559.849174:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+23:14482:x1875400346165632:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:1.0:1788521559.849193:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521559.849215:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440855 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.849270:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.849282:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 24 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.849303:0:14432:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.849318:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 24 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.849351:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521559.849355:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788521559.849359:0:14432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 24 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521559.849368:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f324000, rc 0) 00000100:00100000:1.0:1788521559.849437:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14482:x1875400346165632:12345-192.168.203.48@tcp:101:dd.0 Request processed in 265us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521559.849444:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00010000:00010000:2.0:1788521560.169589:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788521560.172602:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368169600:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.172616:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368169472:0@lo:400:kworker.0 00000100:00100000:3.0:1788521560.173052:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368169216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.174224:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368169344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.174276:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521560.174351:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368169856:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.174377:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521560.174402:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788521560.174409:0:3300:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368169984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788521560.174433:0:3300:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521560.174529:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169344 00000100:00100000:0.0:1788521560.174536:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169344 00000100:00100000:0.0:1788521560.174610:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521560.174619:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368169344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.174693:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368169344:12345-0@lo:400:kworker.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.174700:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788521560.174723:0:15119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169984 00000100:00100000:0.0:1788521560.174727:0:15119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169984 00000100:00100000:0.0:1788521560.174766:0:15119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788521560.174791:0:15119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368169984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521560.174796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788521560.174830:0:15119:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788521560.174832:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169856 00000100:00100000:2.0:1788521560.174835:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169856 00000100:00100000:2.0:1788521560.174860:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169600 00000100:00100000:0.0:1788521560.174862:0:15119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1875400368169984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521560.174863:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169600 00000100:00100000:0.0:1788521560.174868:0:15119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788521560.174888:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788521560.174892:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521560.174895:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368169856:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788521560.174896:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788521560.174898:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788521560.175442:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a75d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368169984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788521560.176689:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1875400368169856:12345-0@lo:400:kworker.0 Request processed in 1787us (2304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521560.176704:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788521560.178622:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521560.178648:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368169600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521560.178812:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521560.178892:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169472 00000100:00100000:1.0:1788521560.178900:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169472 00000100:00100000:1.0:1788521560.178937:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521560.178944:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521560.178982:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c094358b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1875400368169472:12345-0@lo:400:kworker.0 Request processed in 39us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521560.178989:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788521560.179033:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1875400368169472:0@lo:400:kworker.0 00000100:00100000:2.0:1788521560.179150:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1875400368169600:12345-0@lo:400:kworker.0 Request processed in 509us (4352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521560.179157:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788521560.179184:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1875400368169600:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.185206:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1875400368169344:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.185228:0:3300:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1875400368169856:0@lo:400:kworker.0 00000100:00100000:3.0:1788521560.185384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788521560.185476:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368169728:0@lo:400:kworker.0 00000100:00100000:3.0:1788521560.185521:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521560.186014:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169216 00000100:00100000:1.0:1788521560.186021:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169216 00000100:00100000:1.0:1788521560.186075:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788521560.186083:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368169216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788521560.186136:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75514850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a+19:3303:x1875400368169216:12345-0@lo:400:kworker.0 Request processed in 54us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521560.186144:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788521560.186243:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b2a102a8-0149-48eb-bff7-ec9f03a1ca5a:3303:1875400368169216:0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.186302:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368169728 00000100:00100000:0.0:1788521560.186307:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368169728 00000100:00100000:0.0:1788521560.186463:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788521560.186472:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368169728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788521560.186522:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875400368169728:12345-0@lo:400:kworker.0 Request processed in 52us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.186529:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788521560.186580:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788521560.187066:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1875400368169728:0@lo:400:kworker.0 00000040:00080000:0.0:1788521560.553038:0:14466:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521560.553048:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521560.553105:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788521560.553112:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788521560.553231:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14466:1875400368170112:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788521560.553346:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a818e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788521560.557251:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521560.558421:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14466:1875400368170112:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788521560.563280:0:14442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346165760 00000100:00100000:1.0:1788521560.563295:0:14442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346165760 00000100:00100000:1.0:1788521560.563386:0:14442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1788521560.563396:0:14442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346165760:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788521560.563524:0:14442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346165760:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 Request processed in 129us (6287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521560.563533:0:14442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00080000:0.0:1788521560.564250:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788521560.566109:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.566195:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346165888 00000100:00100000:3.0:1788521560.566205:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346165888 00000100:00100000:3.0:1788521560.566275:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1788521560.566285:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346165888:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521560.566315:0:14433:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521560.566435:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346165888:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 151us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521560.566443:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1788521560.570557:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.570673:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346166016 00000100:00100000:0.0:1788521560.570684:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346166016 00000100:00100000:0.0:1788521560.570742:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:0.0:1788521560.570758:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346166016:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.570871:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.570889:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.570902:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.570959:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.570967:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.570973:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.570996:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571022:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571030:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521560.571077:0:14431:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788521560.571082:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521560.571095:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571105:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571111:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571118:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571123:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521560.571127:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571134:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571146:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a4fa31900) 00010000:00010000:0.0:1788521560.571149:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521560.571153:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571170:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae017936 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571184:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571191:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571196:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571202:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521560.571204:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571210:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571218:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8c0a4fa31c00) 00010000:00010000:0.0:1788521560.571221:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521560.571225:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571231:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01793d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571255:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571261:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571277:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571282:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521560.571285:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571291:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571299:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:0.0:1788521560.571302:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521560.571305:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.571310:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017944 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.571390:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346166016:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 633us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.571398:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:0.0:1788521560.576242:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.576373:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346166272 00000100:00100000:3.0:1788521560.576383:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346166272 00000100:00100000:3.0:1788521560.576456:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1788521560.576466:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+24:14483:x1875400346166272:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521560.576488:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521560.576509:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01794b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644085c expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.576608:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.576633:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.576646:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788521560.576657:0:14432:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788521560.577704:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.577717:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.577724:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.577730:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521560.577734:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.577752:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.578056:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:3.0:1788521560.578060:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521560.578065:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.578071:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae017952 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.578128:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01794b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644085c expref: 26 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.578138:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c0a4fa31900) 00010000:00010000:3.0:1788521560.578140:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788521560.578143:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae01794b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644085c expref: 26 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.578152:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a81bebc00, rc 0) 00000100:00100000:3.0:1788521560.578263:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+25:14483:x1875400346166272:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1797us (2031us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1788521560.578271:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1788521560.583431:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.585322:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346166400 00000100:00100000:3.0:1788521560.585336:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346166400 00000100:00100000:3.0:1788521560.585401:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:3.0:1788521560.585411:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+25:14483:x1875400346166400:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788521560.585446:0:14433:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788521560.585595:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+25:14483:x1875400346166400:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 184us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521560.585616:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1788521560.595665:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.596328:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346166656 00000100:00100000:3.0:1788521560.596339:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346166656 00000100:00100000:3.0:1788521560.596407:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:3.0:1788521560.596417:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+25:14483:x1875400346166656:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788521560.596435:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788521560.596456:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae017960 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440863 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788521560.605917:0:14432:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1788521560.605933:0:14432:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788521560.606059:0:14432:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788521560.608109:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017967 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.608130:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.608158:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.608232:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bebc00/0x53df1cebae017960 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440863 expref: 28 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.608253:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440863 expref: 27 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.608261:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737200) 00010000:00010000:2.0:1788521560.608264:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788521560.608267:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a1800, rc 0) 00000100:00100000:2.0:1788521560.608340:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+27:14483:x1875400346166656:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 11923us (12686us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788521560.608348:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1788521560.619305:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.619405:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346166912 00000100:00100000:0.0:1788521560.619413:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346166912 00000100:00100000:0.0:1788521560.619466:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1788521560.619476:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+27:14483:x1875400346166912:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.619534:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521560.619574:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1800/0x53df1cebae017967 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440863 expref: 27 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619593:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737200) 00010000:00010000:0.0:1788521560.619603:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788521560.619632:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619645:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619654:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619667:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619674:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619680:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619752:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619759:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619765:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619823:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6e400 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521560.619835:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619843:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619930:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c0a4fa31100) 00010000:00010000:0.0:1788521560.619933:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521560.619937:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619943:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017975 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619954:0:14431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619959:0:14431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619964:0:14431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619969:0:14431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521560.619972:0:14431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619977:0:14431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.619984:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2f0e447a (ffff8c0a4fa31c00) 00010000:00010000:0.0:1788521560.619987:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521560.619996:0:14431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.620002:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae01797c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2f0e447a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.620177:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0943589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+26:14483:x1875400346166912:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 699us (879us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788521560.620184:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1788521560.634021:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521560.634102:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346167040 00000100:00100000:2.0:1788521560.634111:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346167040 00000100:00100000:2.0:1788521560.634166:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1788521560.634177:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+26:14483:x1875400346167040:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788521560.634195:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788521560.634217:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae017983 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644086a expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.634252:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae01798a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.634265:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae01798a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.634291:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae01798a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.634383:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a1200/0x53df1cebae017983 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644086a expref: 28 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.634402:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a439a0e00/0x53df1cebae01798a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644086a expref: 27 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.634411:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:2.0:1788521560.634414:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788521560.634418:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a439a0e00, rc 0) 00000100:00100000:2.0:1788521560.634550:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+27:14483:x1875400346167040:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 374us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521560.634557:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1788521560.649378:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.649714:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346167296 00000100:00100000:0.0:1788521560.649724:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346167296 00000100:00100000:0.0:1788521560.649816:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1788521560.649826:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+27:14483:x1875400346167296:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.649928:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.649946:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.649959:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788521560.650541:0:14431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788521560.650553:0:14431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 481728779003ns, next at 482728776209ns, rc = 0 00000004:00010000:0.0:1788521560.650719:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056ddfc9d reply state 000000009e8d3904 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.650729:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788521560.651014:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+29:14483:x1875400346167296:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1186us (1642us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788521560.651034:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00010000:00010000:3.0:1788521560.653376:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.653394:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.653401:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.653408:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521560.653413:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.653421:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.653437:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:3.0:1788521560.653441:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788521560.653446:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.653471:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae017991 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521560.655028:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.655118:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346167424 00000100:00100000:0.0:1788521560.655128:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346167424 00000100:00100000:0.0:1788521560.655184:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:0.0:1788521560.655194:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+28:14483:x1875400346167424:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.655218:0:14432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521560.655238:0:14432:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440871 expref: -99 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.655307:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 29 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.655322:0:14432:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 29 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.655341:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:0.0:1788521560.655345:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788521560.655348:0:14432:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e400, rc 0) 00000100:00100000:0.0:1788521560.655407:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+29:14483:x1875400346167424:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 214us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.655413:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:1.0:1788521560.664962:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.667937:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346167552 00000100:00100000:3.0:1788521560.667952:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346167552 00000100:00100000:2.0:1788521560.671610:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1788521560.671639:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2348:x1875400346167552:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788521560.673032:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2348:x1875400346167552:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 1403us (8073us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788521560.673044:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00080000:0.0:1788521560.680063:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788521560.685063:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.685148:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346167808 00000100:00100000:3.0:1788521560.685158:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346167808 00000100:00100000:3.0:1788521560.685219:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521560.685230:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+29:14483:x1875400346167808:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788521560.685499:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+30:14483:x1875400346167808:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 271us (444us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788521560.685508:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1788521560.700441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.701709:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346168064 00000100:00100000:0.0:1788521560.701721:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346168064 00000100:00100000:0.0:1788521560.701804:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1788521560.701815:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+30:14483:x1875400346168064:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788521560.701941:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+30:14483:x1875400346168064:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 128us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.701949:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1788521560.707231:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.707322:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346168192 00000100:00100000:0.0:1788521560.707331:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346168192 00000100:00100000:0.0:1788521560.707389:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1788521560.707401:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+30:14483:x1875400346168192:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.707424:0:14431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521560.707448:0:14431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01799f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440878 expref: -99 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.707518:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0179a6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.707533:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0179a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.707545:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0179a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788521560.707579:0:14431:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788521560.707598:0:14431:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0179a6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.707634:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae01799f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440878 expref: 32 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.707651:0:14431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0179a6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440878 expref: 31 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.707677:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:0.0:1788521560.707680:0:14431:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788521560.707684:0:14431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6e000, rc 0) 00000100:00100000:0.0:1788521560.707751:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346168192:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 339us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.707758:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1788521560.714030:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.714894:0:15117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346168320 00000100:00100000:0.0:1788521560.714905:0:15117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346168320 00000100:00100000:0.0:1788521560.714969:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1788521560.714979:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2346:x1875400346168320:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.714995:0:15117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788521560.715013:0:15117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a644087f expref: -99 pid: 15117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788521560.715038:0:15117:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9aac58, blocks: 0x1 00010000:00010000:0.0:1788521560.715058:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:0.0:1788521560.715063:0:15117:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788521560.715073:0:15117:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.715090:0:15117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.715102:0:15117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a48f6fe00, rc 0) 00000100:00100000:0.0:1788521560.715172:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2346:x1875400346168320:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 194us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.715179:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1788521560.724557:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.724607:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346168576 00000100:00100000:3.0:1788521560.724616:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346168576 00000100:00100000:3.0:1788521560.724678:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:3.0:1788521560.724688:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346168576:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788521560.726977:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346168576:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 1053us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521560.727001:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:1.0:1788521560.733560:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521560.733607:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346168704 00000100:00100000:1.0:1788521560.733616:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346168704 00000100:00100000:1.0:1788521560.733677:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1788521560.733688:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346168704:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788521560.733837:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346168704:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 150us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521560.733844:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:0.0:1788521560.738594:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521560.738718:0:16664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346168832 00000100:00100000:1.0:1788521560.738728:0:16664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346168832 00000100:00100000:1.0:1788521560.738815:0:16664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1788521560.738825:0:16664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2345:x1875400346168832:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788521560.738945:0:16664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2345:x1875400346168832:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 122us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521560.738952:0:16664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000001:00080000:2.0:1788521560.752075:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000100:00100000:1.0:1788521560.760093:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.760446:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169088 00000100:00100000:3.0:1788521560.760456:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169088 00000100:00100000:3.0:1788521560.760517:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1788521560.760528:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346169088:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788521560.760604:0:14431:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788521560.760641:0:14431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e000/0x53df1cebae0179a6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440878 expref: 31 pid: 14431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.760661:0:14431:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:3.0:1788521560.760666:0:14431:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788521560.760702:0:14431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.760716:0:14431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.760727:0:14431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788521560.760969:0:14431:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ac0fd59 reply state 000000002dfdd2d8 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521560.760978:0:14431:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788521560.761069:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+32:14483:x1875400346169088:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 542us (984us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788521560.761076:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00010000:00010000:0.0:1788521560.763996:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.764014:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.764021:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.764028:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bea800 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:0.0:1788521560.764032:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.764041:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.764058:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:0.0:1788521560.764061:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788521560.764066:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.764073:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81bea800/0x53df1cebae0179b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.770697:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521560.772962:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169216 00000100:00100000:1.0:1788521560.772976:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169216 00000100:00100000:1.0:1788521560.773045:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1788521560.773056:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:14483:x1875400346169216:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788521560.773076:0:15114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788521560.773094:0:15114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xfed9f923a6440886 expref: -99 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.773127:0:15114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.773138:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521560.773142:0:15114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521560.773148:0:15114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 7 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.773185:0:15114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.773200:0:15114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521560.773237:0:15114:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6052b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15114:1875400368170240:192.168.203.48@tcp:104: 00000100:00100000:1.0:1788521560.773348:0:15114:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788521560.776558:0:15114:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6052b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15114:1875400368170240:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521560.776613:0:15114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 7 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.776658:0:15114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0a6f324e00, rc 0) 00000100:00100000:0.0:1788521560.776716:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:14483:x1875400346169216:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 3660us (6026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.776725:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1788521560.780355:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521560.780484:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169344 00000100:00100000:1.0:1788521560.780493:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169344 00010000:00010000:1.0:1788521560.780532:0:14417:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521560.780576:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1788521560.780596:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2346:x1875400346169344:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788521560.780611:0:14417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788521560.780643:0:14417:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.780657:0:14417:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.780679:0:14417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6e346a/0x53df1cebae0179ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a644087f expref: 7 pid: 15117 timeout: 581 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.780696:0:14417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521560.780700:0:14417:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521560.780707:0:14417:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 6 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.780731:0:14417:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 6 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.780769:0:14417:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 6 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521560.780820:0:14417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a6052bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14417:1875400368170368:192.168.203.48@tcp:105: 00000100:00100000:1.0:1788521560.780897:0:14417:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a44d2f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788521560.796421:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.796587:0:15116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169472 00000100:00100000:3.0:1788521560.796596:0:15116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169472 00000100:00100000:3.0:1788521560.796656:0:15116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1788521560.796666:0:15116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2346:x1875400346169472:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788521560.796914:0:15116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788521560.796918:0:15116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788521559 00002000:00010000:3.0:1788521560.796921:0:15116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788521558 00002000:00010000:3.0:1788521560.796931:0:15116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788521560 -> 1788521559 00002000:00010000:3.0:1788521560.796933:0:15116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788521560.796983:0:15116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+8:2346:x1875400346169472:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 319us (571us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788521560.796991:0:15116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1788521560.800940:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.801027:0:16085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169600 00000100:00100000:3.0:1788521560.801036:0:16085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169600 00000100:00100000:3.0:1788521560.801085:0:16085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1788521560.801095:0:16085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+8:2345:x1875400346169600:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788521560.801137:0:16085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.801158:0:16085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 8 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.801168:0:16085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521560.801172:0:16085:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788521560.801176:0:16085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.801210:0:16085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 8 pid: 15114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.801225:0:16085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 8 pid: 15114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521560.801261:0:16085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16085:1875400368170496:192.168.203.48@tcp:104: 00000100:00100000:3.0:1788521560.801342:0:16085:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48e1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788521560.803985:0:14417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a6052bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14417:1875400368170368:192.168.203.48@tcp:105: 00010000:00010000:2.0:1788521560.804035:0:14417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788521560.804617:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+8:2346:x1875400346169344:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 24029us (24267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788521560.804638:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1788521560.805435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.805465:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169728 00000100:00100000:0.0:1788521560.805473:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169728 00010000:00010000:0.0:1788521560.805506:0:14418:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 8 pid: 15114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.805540:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1788521560.805549:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+8:2345:x1875400346169728:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788521560.805562:0:14418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788521560.805585:0:14418:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 8 pid: 15114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.805599:0:14418:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 8 pid: 15114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.805635:0:14418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521560.805640:0:14418:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788521560.805646:0:14418:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.805672:0:14418:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.805694:0:14418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788521560.805732:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fe1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+8:2345:x1875400346169728:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 184us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.805746:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00010000:00010000:0.0:1788521560.806531:0:16085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e343c5ec/0x53df1cebae0179bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440886 expref: 7 pid: 15114 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.806550:0:16085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16085:1875400368170496:192.168.203.48@tcp:104: 00010000:00010000:0.0:1788521560.806571:0:16085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806582:0:16085:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806589:0:16085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806628:0:16085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806638:0:16085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806656:0:16085:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806663:0:16085:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beb800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521560.806668:0:16085:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806676:0:16085:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806689:0:16085:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.806697:0:16085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054eba443/0x53df1cebae0179c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.806930:0:16085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2345:x1875400346169600:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 5835us (5996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.806939:0:16085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1788521560.809522:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.809707:0:14432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346169984 00000100:00100000:0.0:1788521560.809718:0:14432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346169984 00000100:00100000:0.0:1788521560.809820:0:14432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1788521560.809830:0:14432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+31:14483:x1875400346169984:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788521560.809905:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.809935:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.809948:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.810189:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.810201:0:14432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 32 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.810211:0:14432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.810243:0:14432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 32 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.810258:0:14432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 32 pid: 14432 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521560.810272:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1875400368170624:192.168.203.48@tcp:104: 00000100:00100000:0.0:1788521560.810355:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a507de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521560.813670:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1875400368170624:192.168.203.48@tcp:104: 00010000:00010000:3.0:1788521560.813699:0:14432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521560.817288:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521560.817371:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346170112 00000100:00100000:2.0:1788521560.817382:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346170112 00010000:00010000:2.0:1788521560.817437:0:14419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 33 pid: 14432 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521560.817478:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:2.0:1788521560.817487:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+33:2345:x1875400346170112:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788521560.817500:0:14419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788521560.817507:0:14419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 33 pid: 14432 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.817520:0:14419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 33 pid: 14432 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.817543:0:14419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6e400/0x53df1cebae017998 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440871 expref: 33 pid: 14432 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.817559:0:14419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:2.0:1788521560.817565:0:14419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.817574:0:14419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.817592:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.817633:0:14419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788521560.817710:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+32:2345:x1875400346170112:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 223us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521560.817718:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00010000:00010000:1.0:1788521560.817960:0:14432:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.817969:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521560.818150:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788521560.818295:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788521560.818340:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788521560.818481:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a60528e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1875400368170752:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788521560.818554:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788521560.818658:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a462dca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788521560.818757:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368170752 00000100:00100000:2.0:1788521560.818763:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368170752 00000100:00100000:2.0:1788521560.818829:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521560.818838:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a60528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14432:x1875400368170752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788521560.818913:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14432:x1875400368170752:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521560.818920:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788521560.818960:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a60528e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1875400368170752:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788521560.820534:0:14432:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788521560.820706:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81ffd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1875400368170880:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788521560.820757:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521560.820905:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a65dd2600 going to sleep for 11 seconds 00000001:00080000:0.0:1788521560.826047:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1788521560.826062:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788521560.826085:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000100:00100000:0.0:1788521560.826232:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368171008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788521560.826297:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788521560.826369:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368171008 00000100:00100000:0.0:1788521560.826377:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368171008 00000100:00100000:0.0:1788521560.826425:0:15114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788521560.826435:0:15114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368171008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788521560.826632:0:15114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1875400368171008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 187us (322us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788521560.826640:0:15114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788521560.826681:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0a81fe0000/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788521560.826686:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fe0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368171008:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1788521560.826738:0:5854:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788521560.827345:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368170880 00000100:00100000:3.0:1788521560.827352:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368170880 00000100:00100000:3.0:1788521560.827391:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521560.827399:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14432:x1875400368170880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788521560.827591:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14432:x1875400368170880:12345-0@lo:1000:mdt00_001.0 Request processed in 193us (6833us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788521560.827599:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788521560.827958:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81ffd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14432:1875400368170880:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788521560.828001:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828012:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828021:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828040:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fc00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521560.828045:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828053:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828070:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:3.0:1788521560.828073:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521560.828078:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828085:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fc00/0x53df1cebae0179d0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828118:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828125:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828130:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828135:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6fa00 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:3.0:1788521560.828137:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828144:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828163:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:3.0:1788521560.828165:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788521560.828173:0:14432:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828185:0:14432:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828193:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.828225:0:14432:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f324000/0x53df1cebae01792f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xfed9f923a6440855 expref: 19 pid: 14432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521560.828240:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0a81fb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1875400368171136:192.168.203.48@tcp:105: 00000100:00100000:3.0:1788521560.828357:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c0a48e1acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788521560.831521:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521560.831586:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346170240 00000100:00100000:0.0:1788521560.831596:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346170240 00000100:00100000:0.0:1788521560.831664:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1788521560.831674:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a7f5f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+20:14482:x1875400346170240:12345-192.168.203.48@tcp:49:dd.0 00000100:00100000:0.0:1788521560.831836:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a7f5f9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+20:14482:x1875400346170240:12345-192.168.203.48@tcp:49:dd.0 Request processed in 162us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788521560.831843:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1788521560.835262:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0a81fb5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14432:1875400368171136:192.168.203.48@tcp:105: 00010000:00010000:2.0:1788521560.835295:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521560.835307:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6fa00/0x53df1cebae017928 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14431 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854234:0:14432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854279:0:14432:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854293:0:14432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854306:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854312:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854319:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854325:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521560.854330:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854337:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854348:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521560.854351:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788521560.854356:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854363:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a6f325200/0x53df1cebae0179d7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854379:0:14432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854391:0:14432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854395:0:14432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854399:0:14432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a48f6f200 already unused, calling callback (ffffffffc1edb4f0) 00010000:00010000:1.0:1788521560.854402:0:14432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854408:0:14432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854416:0:14432:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c0a46737900) 00010000:00010000:1.0:1788521560.854418:0:14432:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788521560.854421:0:14432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521560.854426:0:14432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a48f6f200/0x53df1cebae0179c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14432 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521560.854697:0:14432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a60528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14483:x1875400346169984:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 44864us (45179us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1788521560.854708:0:14432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000020:00080000:1.0:1788521560.854714:0:14432:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788521560.858703:0:14466:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788521560.858713:0:14466:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788521560.858762:0:14466:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788521560.859033:0:14466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788521560.863147:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521560.863257:0:14435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346170496 00000100:00100000:3.0:1788521560.863267:0:14435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346170496 00000100:00100000:3.0:1788521560.863330:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1788521560.863340:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+19:14483:x1875400346170496:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788521560.864336:0:14435:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788521560.864443:0:14435:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788521560.864490:0:14435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.864508:0:14435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.864532:0:14435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.864540:0:14435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.864546:0:14435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.864552:0:14435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521560.864569:0:14435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788521560.864695:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788521560.864703:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.864711:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beae00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:0.0:1788521560.864715:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.864730:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.864754:0:15698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c0a46737500) 00010000:00010000:0.0:1788521560.864758:0:15698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788521560.864762:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.864769:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0a81beae00/0x53df1cebae0179de lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14435 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521560.864809:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521560.864811:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788521560.864813:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521560.867083:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:14483:x1875400346170496:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 3735us (3935us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788521560.867096:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000020:00080000:3.0:1788521560.867103:0:14435:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788521561.041586:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521561.041644:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521561.041755:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346170624 00000100:00100000:3.0:1788521561.041764:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346170624 00000100:00100000:3.0:1788521561.041868:0:15120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346170752 00000100:00100000:3.0:1788521561.041872:0:15120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346170752 00000100:00100000:3.0:1788521561.041894:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521561.041903:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2348:x1875400346170624:12345-192.168.203.48@tcp:4:dd.0 00002000:00010000:3.0:1788521561.041951:0:15120:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9aac57, atime: 0x6a9aac56, ctime: 0x6a9aac57, blocks: 0x1 00010000:00010000:3.0:1788521561.041960:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.041976:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=482s v=(0 0) 00010000:00010000:3.0:1788521561.041995:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521561.042002:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.042019:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788521561.056464:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521561.056539:0:15121:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788521561.056550:0:15121:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788521561.056951:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346170880 00000100:00100000:1.0:1788521561.056961:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346170880 00000100:00100000:2.0:1788521561.057486:0:16669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1788521561.057497:0:16669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:2348:x1875400346170752:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:2.0:1788521561.057536:0:16669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.057562:0:16669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521561.057566:0:16669:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521561.057573:0:16669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.057589:0:16669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788521561.193230:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788521561.251873:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:2.0:1788521561.251911:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1788521561.252287:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1788521561.252295:0:15120:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788521561.252301:0:15120:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788521559 -> 1788521560 00002000:00010000:3.0:1788521561.252305:0:15120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788521561.252320:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.252332:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.252341:0:15120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.252348:0:15120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bebe00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521561.252353:0:15120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.252362:0:15120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.252380:0:15120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.252398:0:15120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae0179e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521561.252494:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+10:2348:x1875400346170624:12345-192.168.203.48@tcp:4:dd.0 Request processed in 210587us (210912us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788521561.252505:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1788521561.253429:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:3.0:1788521561.253443:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:2348:x1875400346170880:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:3.0:1788521561.253480:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.253495:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521561.253499:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521561.253504:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.253516:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788521561.325435:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1788521561.325634:0:16669:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1788521561.325640:0:16669:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1788521561.325654:0:16669:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.325667:0:16669:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.325675:0:16669:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.325682:0:16669:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:2.0:1788521561.325687:0:16669:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.325696:0:16669:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.325743:0:16669:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.325752:0:16669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae0179ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521561.325866:0:16669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6052a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:2348:x1875400346170752:12345-192.168.203.48@tcp:4:dd.0 Request processed in 268367us (284216us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788521561.325876:0:16669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00010000:1.0:1788521561.371869:0:15120:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1788521561.371890:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.371904:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.371913:0:15120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.371920:0:15120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81beaa00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521561.371924:0:15120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.371935:0:15120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.371952:0:15120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.371959:0:15120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d59f8e5d/0x53df1cebae0179f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521561.372367:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75d18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2348:x1875400346170880:12345-192.168.203.48@tcp:4:dd.0 Request processed in 118923us (315908us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788521561.372382:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000001:00080000:0.0:1788521561.372545:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:3.0:1788521561.382403:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521561.382498:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521561.383400:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521561.383711:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171008 00000100:00100000:1.0:1788521561.383721:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171008 00000100:00100000:1.0:1788521561.383821:0:15121:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171136 00000100:00100000:1.0:1788521561.383825:0:15121:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171136 00000100:00100000:1.0:1788521561.383854:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:1.0:1788521561.383865:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+6:2346:x1875400346171008:12345-192.168.203.48@tcp:4:dd.0 00002000:00010000:1.0:1788521561.383915:0:15121:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9aac58, atime: 0x6a9aac56, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788521561.383923:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.383940:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=482s v=(0 0) 00010000:00010000:1.0:1788521561.383945:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521561.383952:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.383967:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521561.384143:0:15120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1788521561.384152:0:15120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2345:x1875400346171136:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:1.0:1788521561.384168:0:15120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.384177:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521561.384180:0:15120:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521561.384184:0:15120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.384213:0:15120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788521561.390752:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1788521561.390881:0:16669:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788521561.390892:0:16669:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788521561.391391:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521561.392602:0:15122:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521561.392627:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171264 00000100:00100000:3.0:1788521561.392636:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171264 00000100:00100000:3.0:1788521561.392692:0:15122:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521561.392698:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171392 00000100:00100000:3.0:1788521561.392707:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171392 00000100:00100000:3.0:1788521561.392725:0:15122:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788521561.392729:0:15122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171520 00000100:00100000:3.0:1788521561.392743:0:15122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171520 00000100:00100000:2.0:1788521561.395871:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1788521561.395887:0:16670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+10:2346:x1875400346171264:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:2.0:1788521561.395930:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.395949:0:16670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521561.395953:0:16670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788521561.395960:0:16670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788521561.395976:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788521561.489954:0:15121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1788521561.489965:0:15121:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788521560 -> 1788521561 00002000:00010000:1.0:1788521561.489967:0:15121:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788521561 00002000:00010000:1.0:1788521561.489970:0:15121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788521561.489985:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.489998:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490006:0:15121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490025:0:15121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325800 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521561.490030:0:15121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490039:0:15121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490061:0:15121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490086:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7b41020/0x53df1cebae0179fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521561.490186:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+17:2346:x1875400346171008:12345-192.168.203.48@tcp:4:dd.0 Request processed in 106318us (107787us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788521561.490195:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:1.0:1788521561.490228:0:15121:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1788521561.490240:0:15121:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+16:2346:x1875400346171392:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:1.0:1788521561.490270:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490282:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521561.490287:0:15121:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788521561.490293:0:15121:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.490304:0:15121:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788521561.501203:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:3.0:1788521561.545876:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:3.0:1788521561.545895:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1788521561.545931:0:16670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1788521561.545947:0:16670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.545960:0:16670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.545969:0:16670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.545977:0:16670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a439a0200 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521561.545981:0:16670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.545991:0:16670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.546010:0:16670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.546030:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034d61ab3/0x53df1cebae017a08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521561.547411:0:16670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+10:2346:x1875400346171264:12345-192.168.203.48@tcp:4:dd.0 Request processed in 151520us (164006us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788521561.547424:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1788521561.547454:0:16670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1788521561.547466:0:16670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:2346:x1875400346171520:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:3.0:1788521561.547498:0:16670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.547513:0:16670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521561.547517:0:16670:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788521561.547523:0:16670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.547536:0:16670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554305:0:15120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554324:0:15120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554333:0:15120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554360:0:15120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f324600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521561.554365:0:15120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554374:0:15120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554394:0:15120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.554402:0:15120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062f867b2/0x53df1cebae017a01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521561.557695:0:15120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a9d6363a-faa2-4e4e-95b5-3945c860eba1+11:2345:x1875400346171136:12345-192.168.203.48@tcp:4:dd.0 Request processed in 173533us (175186us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788521561.557710:0:15120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000001:00080000:0.0:1788521561.596610:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1788521561.596763:0:15121:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1788521561.596896:0:15121:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788521561.596911:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.596924:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.596946:0:15121:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.596954:0:15121:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a6f325600 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:1.0:1788521561.596958:0:15121:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.596968:0:15121:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.596989:0:15121:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788521561.596997:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008284c843/0x53df1cebae017a0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15121 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788521561.597154:0:15121:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a9d6363a-faa2-4e4e-95b5-3945c860eba1+9:2346:x1875400346171392:12345-192.168.203.48@tcp:4:dd.0 Request processed in 106913us (206419us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788521561.597165:0:15121:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00002000:00010000:3.0:1788521561.637532:0:16670:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788521561.637557:0:16670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.637571:0:16670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.637591:0:16670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.637626:0:16670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0a81bebe00 already unused, calling callback (ffffffffc14974f0) 00010000:00010000:3.0:1788521561.637632:0:16670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.637642:0:16670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.637662:0:16670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788521561.637670:0:16670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b7bb755/0x53df1cebae017a16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788521561.637860:0:16670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81ffce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+7:2346:x1875400346171520:12345-192.168.203.48@tcp:4:dd.0 Request processed in 90392us (246465us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788521561.637870:0:16670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000001:00080000:1.0:1788521561.638315:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00000100:00100000:1.0:1788521561.705661:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788521561.712459:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c0943588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368171264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788521561.712544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788521561.715666:0:15118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400368171264 00000100:00100000:2.0:1788521561.715681:0:15118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400368171264 00000100:00100000:2.0:1788521561.715819:0:15118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788521561.715831:0:15118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a6ddc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368171264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788521561.715857:0:15118:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3859808256 avail 3849322496 00000100:00100000:2.0:1788521561.717575:0:15118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a6ddc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1875400368171264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1740us (5023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521561.717586:0:15118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788521561.717625:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788521561.717632:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0a81fe0000, transno 8589934596 00000004:00080000:0.0:1788521561.717652:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788521561.717685:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c0943588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1875400368171264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788521562.216979:0:14420:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788521563.241460:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788521563.250852:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521563.250902:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171648 00000100:00100000:1.0:1788521563.250914:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171648 00000100:00100000:1.0:1788521563.250974:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:1.0:1788521563.250995:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a75514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+13:2346:x1875400346171648:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521563.251144:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a75514450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3a30bcea-542d-4612-9aa8-72900b2931cc+13:2346:x1875400346171648:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 160us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521563.251151:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:3.0:1788521563.256969:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521563.257026:0:16664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171904 00000100:00100000:1.0:1788521563.257037:0:16664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171904 00000100:00100000:3.0:1788521563.257102:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521563.257120:0:16664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1788521563.257135:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1788521563.257144:0:16664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2346:x1875400346171904:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1788521563.257162:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1788521563.257186:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00080000:0.0:1788521563.257234:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788521563.257416:0:16664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2346:x1875400346171904:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 276us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521563.257424:0:16664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1788521563.257441:0:16664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346172416 00000100:00100000:1.0:1788521563.257445:0:16664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346172416 00000100:00100000:1.0:1788521563.257473:0:16664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346172032 00000100:00100000:1.0:1788521563.257476:0:16664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346172032 00000100:00100000:1.0:1788521563.257493:0:16664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521563.257498:0:16664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2346:x1875400346172416:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521563.258496:0:15117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1788521563.258555:0:15117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2346:x1875400346172032:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521563.261905:0:16664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2346:x1875400346172416:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 4390us (4755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521563.261923:0:16664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:1.0:1788521563.261976:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346172160 00000100:00100000:1.0:1788521563.261997:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346172160 00000100:00100000:1.0:1788521563.262050:0:14433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346171776 00000100:00100000:1.0:1788521563.262063:0:14433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346171776 00000100:00100000:1.0:1788521563.262086:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1788521563.262095:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2346:x1875400346172160:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521563.262164:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d3d61bb-199f-444a-897c-ee821b4c8e79+6:2346:x1875400346172160:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (5062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521563.262182:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1788521563.262197:0:14433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:1.0:1788521563.262204:0:14433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:2346:x1875400346171776:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1788521563.262234:0:14433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+21:2346:x1875400346171776:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (5072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788521563.262240:0:14433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00080000:1.0:1788521563.262262:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788521563.262267:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788521563.263369:0:15117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a9d6363a-faa2-4e4e-95b5-3945c860eba1+5:2346:x1875400346172032:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 4853us (6172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521563.263382:0:15117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1788521563.264047:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1788521563.265212:0:16664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875400346172288 00000100:00100000:2.0:1788521563.265226:0:16664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875400346172288 00000100:00100000:2.0:1788521563.265294:0:16664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1788521563.265305:0:16664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0a81fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2346:x1875400346172288:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1788521563.286625:0:16664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0a81fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d3d61bb-199f-444a-897c-ee821b4c8e79+5:2346:x1875400346172288:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 21297us (22558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788521563.286643:0:16664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00080000:2.0:1788521563.293805:0:14428:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788521563.367952:0:16708:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788521564.264906:0:14421:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29535 lines, 29535 kept, 0 dropped, 0 bad.